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"INTRODUCTION AND OVERVIEW OF THE EVALUATION , 2 32 : 


oy seen « 3 : e 


_ The overall goal of the Improving Teaching Competencies Program (ITCP) vs 


: sel the Northwest Regional Educatigagt Laboratory \(NWREL) ,_ ‘as stated ‘in its 


pemounee ‘Atlooation and Management Plan (RAMP) (improving Teaching: 


. - Competencies Program, 1974) ,. -is "To develop inatructjonal cae for | 
Xe nes 
‘training school personnei in ‘Process skills which will ‘promote student oe 
‘a oo eo 
‘self-understanding, self-sufficiency and independence," The RAMP further ‘ 


"specifies that:  ° . ‘a, - . = “Bh ae - 2 
: te . . ; ae we. -_ y° 
‘These instructional. systems _will ba competency based, ; 
ro _ low gest and. mass diffusible-for~ preservice and inservice pe 
fo — training in: GS) foupportive cu Glar:mateérials which ' =” _* 
‘. - encourage ‘pupils‘to be active learners; (b) verbal . © ‘ : 
“behaviors that enable students.to derive personally | 
™ ; "usable meanings for what they learn; (c) analyzing and . - co 
: improving individual teaching styles and using problem- 
' solving processes; (d) using basic interpersonal’ skills; 
% (e). providing for continuous growth of teaehers and. 
contributing to increased Puneeeenee capabilities on 
organizations. (p. 6) a a 


. This report focuses on the Prepdting Baucational Patan ponsatecnbe: 


r) 


 Skille Pnainere Instructional System (PEI6-1) , one of ‘several ‘tastructional 


? 


ystems developed by the Improving Teaching \Competencies Program in 


accordance with. these goatee Based uped: Suamareve evaluation data, this 
° om 
technical report provides information for the benefit of. potential, users 


- ‘of the system. 7 8 


‘ 


Preparing. Educattonal Draining Consultante (PETC) © isa series: of -«- 


‘ 


three oe and peauentaee jastructional a es colar curfently being 


“owN 


developed by the Improving Teaching Conipetencies, Progran of thie’ Northwest | 
Regional Educational Laboratory. ‘The puRpose ae report ts’ ae present 
the results of a field test ‘for the first ayeren in the ‘PETC series, . 
Skitte Trainers. (PETC-I) , This ‘instructional system is designed for’ mass 


statesbueton and use in the preservice or Inservice training of educators. 
eet tee SS PS a es OE 
ERIC 


{ “The naterial¥ of this system ‘prelude training strategies. and procedures 
plus pareiétpape ‘inatrudtionel eeicaara oo, ee Oey : 4 
The training fot penC-1 is divided intq_two seumenty: The first. : 


— 


‘part consists of. a 60-hour workshop ae QO. fant Lidrize participanté 


Ne, 


instru tional: strategies: and 
g in group process, skills. The 
' second part Ronsteece of a 35-hour ‘practicum experience ‘in. which teams. of 


. participants (Galled skills trainers) with guidance of a ‘senior trai er as 


needad, conduct a workshop in Group Provess Skélle (GPs) ‘Toe teachers nd 


a oy 
other sdueational ‘personnel. The latter igdividuals: are called GPs 
TR, 
participants’ . an - 

: PURPOSE OF THE TECHNICAL REPORT ae iz . . 
; %. : 
This document reports. on the tinal phase ‘of ‘the proces ead by 


> 


‘the Improving - Meachitng conpetenéies Progran in the development of Eatte tT: 
This developrient wag based on: a model which divides che work ° flow of an, 
instructional systen into ‘five phases: planning: pilot Ypteria, field. 


test vand outcome. Each phase consists of specified development, evaluation : 
$ 
and’ field relation: anticiviee which differ according to the phase under * 
You 
-Zonsideration. ' k JBEaee ‘esgription of the model | is ee in Appendix A 


i In the final or outcome phase, development of the instructional. 
system has been completed ase seesene ‘is focused on a sumiat ive” evaluation’ 
oe. %, . ces . a - 
of ‘thie ‘eyaten” — to. odie ephcified short- and ‘Llong-tetm outcomes.’ 


es Sh rt-term ‘outcomes are participant satisfaction; skill scutetiion, |” 
L- guvarece! _and immediate performance change; long-term outconies include. 
‘ 


Heb eaaeton of knowledge and information. Of. interest ds the general “impter. : 


¥ 


ae aN 


of the’ instructional system on secondary, audiences. such’ as students rs Ga 
peers. For ‘this reason} the terms "impact study" Tend? Poutcone e evaluation nv 


+s : ‘ —, 


-. are used, ‘interchangeably. throughout, this report, ee ‘e 


= oe ‘ . . - a ‘ > : . ear Pe es 
ae oe ee ae 


. - 3 : 4 ao y eee ‘ om os : * - a ; . A : 


i. - nee 


si 
... i Tee purpose of itis technical report, ‘then: ‘is éo present the . =. 
‘ i : oy s, ; 
.% “results of the outconM@evaluation/ impact study. -ALtiough the evaluation . 


. . 


e,. 


was, "conducted primarily. for: nn _Mgpoee of of assedsing fia long-term, Ba 


a rae 
- - outcomes, pe PETCL,. Ss eacne cere éutcomes are saieo addressed. The 


‘nee 


a technical: ‘eport of the ‘outcome evaluation of ies PETC-I inséiuetionsly 


hb 


“cs ; 
cavsten wail sulfa the contractual agredments of ~ Improving Teaching * 


“sSaepeiancteg, Progran,g of NWREL, with tts. eoastng agency: nae a oe 


x 


— " PURROSE. “OF THE EVALUATION . br uate Sarg . " } 
eo ee i x ae : ae 


jo this: evaluation submitted the PEIC-T instnictional systeni, to a : 


an ee 
. 


series: of tests where information was coftectéd. to: ‘determine: eo a 
” Son fis , me 
ne Pieced ot of ‘the Apatruetional, system | on (a) skiils 
- 7 ‘trainer. ‘satisfaction,’ -(b) :‘their perceptions of the © 
me _relevance,. ‘wel lity -and. ‘need. oF ‘the training aad’ eae) 
a ae ‘Fifowledge - our copes ie * . ae a ee 
a Fee 2. “the laser vacices of PETC-Iprerequisites ant different | nS 
one — conditions of training for meeting satisfactions. ; 
.e perceptions of. relevance, utility and need of the 
: _ training and knowledgd Gubcomrs —— 


ee, Be The. effects of skills: trainers with: si etucent a 
’ ne ae prerequisites ard conditions of training in 
a ee * producing outcomes of satisfaction, perceptions — 
NPE ee '. of Yelevance, utility and need and of aaa ae 
‘of GPS trainees 

* : 
4. me impact ‘Of’ GP training on classroom climates 
: teachers who | ahd GPS workshops’ 


r Three Dias eaten « stu ies were conducted to ofan: ine the major 


he ¢ : 
issues cited abote. The first study: ‘compared? outcomes of three groups 


. of. skills ERainers ‘Subjects were recruited ad assigned at random, 
a 
test of (a) the eaRORCARCS of the ‘PEIC-I prerequisites and: (b) the 


“ efficacy | of PETC-I training versus an abbreviated treatment. 


e 


oe 13 
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. when pawaible: te thee different treatment conditions so’ as to: om 


«= 


‘<) 
ERIC 


% $ 
— — stuay, 2 provided-a compatison of the effectiveness of three groups of 
w [ae 47 - 
‘vekills: trainers ‘in producing ougeoties. at satisfaction, perceptions of 


oe 


Kerevance, utility: and need an of knowledge’ in GPS traineds. fe a 8 


wr: 
* Study, 3 investigated the. impact of GRE: training pn. ‘the cfassroon : 
~ 3 * : 


% 
ai ‘of teachers parkictpsting ‘in’ GPS: ‘Workshops. This “study compared | 


> 


a 


three groups of’ teactierss-teachers ‘teatoed ae GPS, seachers trained in, . 


os a Influence ‘ak teachers, rekeiving an abbreviated: | treatment. | 
ait _ . . 
alll ee 24 *, COG ee ge 


c o. 


Auprences FOR THE TECHINTCAL REPORT .: he es ie 


Py , 
ot 


d 
re ‘Several, potential qitioncee -have ie égnsidered, in the planning and 


~ Amp Thentatton oe Soares evaliation of the. berc-r systen aad. in the: 


ve 
a 


preparation of, a Repert. co information contained in this, evaluation 


Le aes ; 
FEpOYE should. be Televant to the ‘concerns of three grouper" ; 


il. \ Personriel in the Improving Teacting Competéncies 


:. Program at NWREL who are responsible for ee a) ane ‘ 


_ a _  Yvevistons or extensions - the systems — , = 
: . . es a ‘. 


; 23 educators: “who may joventiariy, use the system and 
. - > who need valid and reliable informatiod.in order |= __ ane 
: to choose among inservice educational alternatives; Z - 
i ‘these educators may include ‘the teachers and . 
' . administrators who-desire to become workshop | ; ca 
“a participants, curriculum specialists or those who } 


_ provide training opportunities for teachers ° be 


a Eee nen : Sate ects ad besansttvicewes 


3. ‘Members of the rer Institute. of ‘Education’ “Cate) 
ke who monitor the progress and assess the quality of : 
. ‘QuEDUE from the Improving. Teaching Competencies Program 
\ . 8 x ‘ 
REPORT FORMAT Cc. — Eas 2 ee ™ 
. This report includes five’ chapters. In Chapter , ‘one, the PETC-1° 

ic system is eserabed including re history, 0 Gest Ke 

components. ‘Specific. evcieien activities (destens, instrumentation,’ 

samples data enaly see and results. from three independent studies aré - 
. described and discussed in Chapters Two, Three and Four. eHApECE Five 


: ae - ‘ 
presents a‘ summary oe the evaluation and a brief ccd of ‘the results. 
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Be ee ee Oe | GHAPTER ONE- = gs an - 
7” : ae oo ‘ . eo ; - A 7 : a ; ie i as _ - 4 _ , A C : 
= . DESCRIPETON, OF THE "FEIC-I INSTRUCTIONAL ssTEt oe me Se 


This chapter proviges a | description of the PETC-I. instructional’ eystey 


: "the first sectien ‘provides. an overview of. ‘the. PETC series, ite the ‘secc e 


“section describes che gttacegion a materTets. Objectives’ of ‘the systen 


and “ats developmental history" are Ancluded ‘in the final sections: 


| 


“ 4 te, 
. : Sa eh ae 
. . te 


nats EW OF rae Pete rae <u = : ie rere Le 


One: oan. basid goals of art Teaching Compatenctes Program c 


Mg te improve ‘the organizational effectivedibie of educatio Yorganizations. 2 


4 


This goal is accomplished. by" providing educators with prac Acal: 


: "ang hits drawn from the. Literature and research of. hull 


Trt ie 


vo ‘. 
- BeQUP * ayhadive: ‘organizational developnelig, and planne change.: - : 
7 - The foriPwing two-fold strategy, is used? ae i, ° 
SE ag ‘Provide siueneeien and dmeewick trgining. programs a aor 
' = “ for all educators in the knowledge; skills and 


*.Values of basic group processes: ‘guch as, inter- — ee 
' (personal communication, es and- suber" 
e “\personal influence ‘ 
. Mie? 
. 2. Grain a small proportion of ieee to Sroyide 
: » §raining in\group process skills (PETC-I),. 
‘consultation\in a temporary relationship (PETC-II) - 
-and long-terfa rganizatiqnal consultation (PETC-IITI) 
a ye ye iassatcari 4 is. Sep ed ‘6 provide | individuals and fatact 
ips Fi 


‘groups with particular group process knowledge; skills and“ values, ‘wifile - 


. the second strategy is. ‘expected to ‘provide “support for. the inplenenfation 
of the systems. Whether these eee Bias can be put to effective use in 
& 
schools and whether they will/tead to improved organizational? functioning 


: depende on (a) the. eitactyveness: 0! of the knowledge, skills and: values any 
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“aigaining | ‘the desired ends. and com ‘ie degree of extaging support for. : 


t : . lei on r : 
3 ete A Gage IWR 


‘ . : idol ie i Be Parc °F. ‘ 

“The PETE systens are ae the rationale that educators, with. 
os hae 
thedd ‘abilities can help schools: -conkiaue’ te ‘grow in organizational te 


\o effectiveness. by fact}itating development, of « climate supports Pe 


a 


. 2 2 
application of the process skills. "Educators trained in the PEC syatens 


; & cae 7 
-, ) are’ exrected rouse: ‘their antiesty to help other's incgeas 


- = coupellencies in. cakrying out thegr. educational programs. 


“a small portion of educators will be trained in) these pa GCA 


OO 
"persons w412- ‘improve, the functional 


. capabilities of: groups al Siganieas 

A ‘tions’ and will influenée ‘che: waya adniniettagges, teachers, students | 

, ; ss parents get goals, clarity communication, reach out 6 use  Pelevant 
“mancurces, syatematicaily solve problems and make cisions, agsess_ 


s 


’ ° 


~—, . 
progiess goward goals and cope with interdeperidetce and“conflict.. -_ 4 


Po 


‘The developers, of the PET eystens Propose, that levels of trainer-. 
dite be conceived asa , hierarchical pyramid thown-in Diagram I, in | 


which trainers at. the top’ ‘now and can a6 more thari those ac the ‘bottom, 


t 


. as sp no moves up in the hierarchy,. both ‘the. breadth aaa ‘the depen of: o 
a 2 3 


trainer compétencies increase, 


’ the pyramid 1 distetpurton of erainership levels “and. relationships 


= ‘simpler dvels feasible, for less skilled errno ‘This breaks a 


3° 


a 
long. Stand ote bottleneck in process ‘training in which costly experts arg 


needed for even ‘stinple procegs leweaing experiences. ‘Pressures fog this . 
_ 
breakthrough come both from positive need for. process learning and from 


“the negative backlash of- experiences created by inadequately trained 


v 


-trainers.- This breakthrough has become possible through being i eae 


about ‘the processeé and. trainer ‘competencies ‘and by the ‘creation of 


support materials. 


6 - : e ; : 7. y . : , 7) eee « _ 
oe 7 7 ae 16 we Pe 4 


. - bs : ? ? oe oo me : 
E . oe : : I ” 3 
. = % Fos : oa 2 . 
i a : aa J a or 
: ’ 


ae Diagréa : ae a eae 


as = ) . “hes, a ; = oe 
+ ‘the Pyramid, oe Procgets Teainérship® a ee ee y 


es, aes ~ 4 . os Je, ‘ ieee es ; ; ; Se Ne : 


. Fdeld Specific - 
es Consultants - 


* protess ‘SPecitic. ee. 
. Skills Trainers §<, 


me 


Skills ‘in Using Self-Instructional : 
Redcat ree Materials ; ,‘ 


y 


ag an pie 2 Nee : nee 


! 8pino; R. and R. | Bnory. "Preparing Educational, Training’ “Consultants: . 
Skills: Training (PETC-I).- Portland, Oregon: Northwest. Regional \ 
. Educational Laboratory, 1976. p- 131. , .* ; 


| In Diagram II, a second inverted triangle ‘is’ shown. to ‘0 represent the. 
sunny that ‘a trainer at each level of the pyramid knows and can eee 
7 “Trainees who complete ‘the PETC series. belong in the ‘category oF. 
‘Field Specific Training Consultants. Other NWREL tnatructional systems, 
such as Interpersanal Communications (IPC).*and Research Ueiliaing Problen 
.« Solving (RUPS) belong to the category of Process Specific Skills trainers. | 
PETC~I is ‘the, first in the ‘series ‘of the three PETC systems, and is 
| constructed to be a prerequisite to the other two programs. The PETC-I 
trainee (skills trainer) is expected:te be able to work with’snall groups 
to assist in improving ‘précess_skills such as - goal setting, problem . 
solving, eqmmuateetine: influencing and decision making. The ‘intended 


relationships ‘among the PETC systems are shown. in Diagram iii: 


i? os a ie y A 4, > | : . : > 
<) : —— "3% . ae “yf . me - 


ae ie ce , tp Bah se etiegese ee a 
at ere 7, one 4 < NR: eo ME E s a ce ee $. : eats m 
ane ot: "Competencies of Process ‘Trainers® ~~ a pena 
ba ee ee ie ee 
S Be ane Oe ae a 
7’ ie Ks % 7 7 : fo 
: a : ‘ oY 3g ; 
HES a we on fis 
i ats;- ‘work across a? Mee 
jae P ng sulting me 
oe " pleld Specific - 
_@. Frateiog ¢ Consultants a \. 
” Process: Specific “st Strictured training’ 
; . : Skilla Trainers in a‘specific “f°: 
os eae process ; ‘ 
of Skills "rl Using. Self-Instructional ; ae 
ess Sean hs eae . a . 
PS | . ; ; ‘ 2 : y : ; 
Bins, Re and R. nee Prepart ng Buoy tonal’ Training Conaut tanta: a 
Skittles Training (PETC-I). ee egony. “Norghwest | Regional - 4 
" Educational’ scrim: oe 2 ae ee 
Ze . ; Pa oie oe F at - a 
“Diagram III aa pis _s eae Oana 
We ace Fg ee Relactonstins “Among: the PETC 2 Systems” . 
| Factors. #2! ‘PETC-IIT: 
Involving _ gta ads 
. | the Client aoe Development) 
| Uaual client . Small group or: |The organization © 
syatem ‘major subsystem, {although most - 
of the +s Jof' the work may” 
: organization =< |be‘with a major j°" . 
. subsystem) . ~ A ESS 
, Assistance 7 "| 9, help the? To. ee _ 
for the ,|.group obtain a tain improved , ; ) : 
; eltent: goal by supple- ‘| furtctional. is 
’ ‘|menting weak capability of jo. |. 
: functions such. . the organization, Sie oe 
: as planning or ~ — bbe 
aecdezen aking -| validating - — a a ae 
a ot. ; maar any a SR 
| Usual duration |A feu hooks or | & few days or A few months or. 3 
of eltent days” ae -tweeks | .[2 er 3 years 
relationship = a foe, 
8 - = ‘ 
+ Y . e 
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- DESCRIPTION OF PETC-I: STRATEGIES AND MsrERLALS Cir se ee 
Be The PEIC-I system ts a \eworweek workshop that. is organized, into two. 

‘ parte.” The first part” “of the, progran consists of a one-week trataing, 2 
cam program during ‘iat Via: perc\y trainees (skills. trainers) study the a . 


oad "paste roncey } of the éaoservcrfonat 9 eysten ‘and group process. skills 
; i oll 


ar ‘training. “These workshops are conducted by. senior ‘traineré: ‘who: meet tab 


oe ite ‘e : a - 

z criteria specified by the. development, ‘team. ‘These. criteria. and the, ( = bie 
| 1 = 
Cama! for selection of skills trainers ‘are listed in Appendix. Be “The. 
first section of | ‘the workshop’ ts designed to accommodate Between’ 12, and” 


; 26 skills trainers. The wunber of skills ‘teainers: ‘mabe be a. ‘multiple. 


“of thr e 80° that, trios can ‘be formed, | The second . part oe ‘the. workshop 


‘ 2 is a. 


ractigm § for ‘thé skills trainers’ im jghich they forn"Frios to wot = : 
My i i . 


‘a 
Ne 
_ with a group of - 12 to 24 péople. ‘The secqnt eraining. ‘week, te: ‘referred 


to as. hie’ Group Process skitis (GPS) worleshey , and ‘the second set: of | 
7 : participants ate alled Gps: ‘erainees, . PS c ences learn: ea proctaogg. 


. skills from the “trio offettiie erdthers. a NL 4 a a’ it % ae Cs 


‘Skills eratners are educators! who’ aah to ‘acquire skills for trating ai 
others tn group. Process setihe. To be eligible. doe PEC-I craining, they, . 


, mud complete! two' other. NOREL prograns, Researoh Nhivening i Problem Solving : 


(RUPS, | ged Interpersonal: Communications (Tec) ‘ “Participation tn 


» 


os Pa -I is voluntary: 


- GPS traineewhgy be clasérgos teachers, ‘atdae, support: stat, parente, . 
- 
central office: staff, iprincipais,. vicelprinetpals and ‘others in the: 


- qducatténal setting whio wish to improve their group ‘and ‘interpersonal 
cag There are no prerequisites, a a - “iy . 


- 


as \RUPS: - Research utibieing Problem Solving; 1972. ivatlabié’: from. 
7 Commercial Educational Distributing Services, P.O. Box 3711, Poretand, 
» Oregon 97208.: - ; 


2p: Interpersonal. Comminica iona; 1972. Ava foble from 
} il, Sterling Forest , Tuxed aa ess 109 ao 


x * oe ‘ Ne < 


; a3 fu aioe 
“Materials stpplied in the. PETC-I instructional system includ 


leader's manuals (Part. ; Skills Training and Part II: GROUP, Proce s 


skille); two, sets of participant materials (Parts I and Ii) ata ‘a 


collection of skill exercises and theory papers. In addition, sehior - 


names tags, ‘three-ring binders, BEVSPrENE piss fele-tip. pens, i paper, 


crayons and masking tape. ir ' 


a : ‘ 


“Leader Ss Manual ,_ Part I ce 


: ceratnfhe 4 is’ "140 ages ° n lengtii. Ty includes guidelix es =e setting uP... 
se, 


outlines the design arid “eahediid of, eféining and brief discisses th 


’ ~ : < 
- ‘bbjectives, pce os target pattie teat a aa and he role: ‘ef’ 


- 


session-bysession. For each Session there are’ comments, on. -the purpo ¢ 


time’ required,” ‘the ‘rationale’ fof ,the seston’ 9 activitiesy “Expected” 


“participant outcomes; “traindr preparation deeded ‘and the Wbeniceional: 


strategy, "the strategy describes a 1 abquentlen set of activities for. 
each session, the. tine and materials needed as each ‘activity, and | 


specific directions to the “erainet + "Senior crainers also reckive eapiee 


b6 ~ 
‘ 


of participant materials for dach: session anid “the collection: of exercises 
a Bowe * 


_ and theory -pagers from which one partiotpant activities: and” nidterials 
. for Sessions 8-9 snd’ 12-17 are | drawn. Rach kind of material: appears on . 
: ny 
a different color of paper ‘aa all are packaged to fit, into a three-ring 


‘ 
© : ote oS ght 


pander. 7 . “s : : ? . a * : ae “& . . : oe 


- ) ae a oe 
“Leader's Manual, Part II A ar “ Vee 


. "The skills trainer’ s manual for ‘conducting the GPS ‘workshops is. 87 


2 


pages in* Length. “It inéludes session summaries, instructional strategies 
We eg BG eS 
. a i, ; “a :% . _ 
@ : 
ERIC 
ENC 


og 2 i . a ee 2S a | ee 
and participant materials similar’ to those’ in ce leader’ 8 a mandat part, LL ee 
oe “ 
~ ‘The ‘skills tepiner ‘also’ receives ‘the. es eollection of: exerciges « and’ theory 
4, \ . 
— from which to draw pare reapane activities and additional materials - 


cae for’ Sesdions g-18. ‘The are tals. are “eplor-epdéd "an pockets to fit. a 
7 "three-ring binder. me or : os a ae _ ee C : ao 
{ participant. Materials, Part I . ca | se ‘ . 
a og The on manual “for the. ftket part of Pere-I “s 10, pages a 
ay pre materials include brief thesry papers, ‘Aintrdduct ry, materials 


cises, instruct itas, worksheets, tating forms. and ‘other ante v wy 


Sa eee ee 


copies of ‘the ‘collectién of exercises and ehéory papers. : “these become | 


. wt Big er} ie 
a component. of their leader’ 8 ngnual used Q_ 


» ” ee 


Part II... Ma a 


Ka a sa ao” hy 1: : ling Se wy 2 ne 
for! Par a ; se ve. i; ay : SE oa ao oo — ers _ “a et 


It ‘consists of 30 exercises =e deal with different aspects ‘of group, : 9 ‘ 


; 7m 
a “Processes and skills needed to benefit group process. ‘sxerctues over : 


apsuch ‘issues ‘and skilts, as | pro _ solving,” the helping relationship, cae } 
4 pow, 


leadership *atyles, communication, skills—giving/ receiving feedback and - - 


ony 


: two-way/one-way. communication, consensus decision making and aa aa ie 


“There are 16 meer papers which accompany some of the exercises’ as aids 
to ‘skills trainers’ ‘understanding of a particular, concept of group Process. 

a of a i : 
- The materials’ are ‘éolor-coded to facilitate distinguishing between ae 


‘ ingtructional strategies, part tetpant materials (exercise. handouts) and 


ees papers; ‘They, are packaged * to. fit into, a thpee-ring binder. 11 


ENG seg ae oe 


. 


In addition, ‘ech workshop, requires di supply of exercise ‘handouts | ‘to: 


* 


“cover -those. exercises selected by vee “for their participants. 
4 -“Orientatio Kit y. Z : “a v ; _ - ae a” 4 ae 
\ Pane . 5 i: e i 
this’ kit, no isbeer commercially available, delineates the different - 


ya3 


és f. o.. 
responsibilities of the host and senior trainer, gives a list of. necessary 


materials and a aia list of supplies aa presents a. sequential 
Preparation chetklist for the pst. to follow in arranging fora local, _ 
 PETC-T workshop. Two information- lyers (orientation brochures) have 


#blso been developed | to allow potential participants in either Part of 


PETO-I « fo: ‘know w at: ‘they can. expactico gain from Participation and the 


o 4 72 a ere -. 


« rabid 


GOALS AND 0 SECTIVES ‘OF PETC-I ris 2 2 + | : 


v 


dna, sroupe. to this a, skills traf er eee oe PETC-I cysteit Bey 


“ee expected to méet the. » cognitive ‘and performance objectives listéd 


pants objectives os a : an = - | thee as 

- 7 "woLtowing the PETC-I workshop, skills trainers should: . : - ; se : 
, i. Ga the: roles of a okt s | eae asectees ‘ 
; facilitator, Staggoser sgesiguyr « and trainer) ou a 


_ BR yndafstand dimensions essentt 


. 


for ‘group growth 7? 
y 3 \ r a 
: 3. Understand | ‘skills needed by rs of ‘productive San << 
vo A groups: .- : . 2 : - ee 


4.. Understand the guidelines ‘ ‘for seletting, sequencing, 
“y, modg eying and oe : skills: praiuiog: exercises , 


19 os ss . an - ee Se ey 
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- Performance Objectives, | > 
Following the BETC-I workshop, skills eetaehe are expected to ne : 
v nfhentemees : ce. : 


able ‘to’: | ne 7 - 2 - ( 


1. ‘assess issues and problems aa ad agnose skili needs 
of individuals and groups / 


. 


_2. Identify the skill needed: t influence or: reduce 


st those p oblems. x er 
. ™3, ‘Develop s and implément a ‘plan é to: -impfove the = group’ 3 
. . processes —_ ast 3 ey | \ | 
“Many ‘of the knowledge outcomes expected from skills traingre 4 are also’ _ 
Lae for. GPS aoe. ae ee Se 8 <3 = 4. ° 


ee 


-In addition. to providing knowledge ‘dad’ skills for. the PETC ad. 


. 


PS trainees, the PETG-I aysten includes ' “gome imp1 cits ctations. | 


abodt the ate of. ‘the ‘traintes on: their work environments. For. 
example ,. because PETC-I and. GPS trainees are expected ° tbe able to a 


Ca 


facilitate communication, decision making and other -Broup process skills, ; 


~ 
e the groups with which t ey ‘work shoutd develop 1 more Sok: and effective 


climates. Trainees" ; 


f 


; DEVELOPMENTAL HISTORY 
3 

In the mid-1960' 8, the National Training Laboratory developed a. 
training program: to provide. educational! consultants with group process . 


4. skills. ‘This akills ‘training was coupled aa techniques and materials 


from onan relations’ training and organizational developiiént and involved | 


} : 
a four-week training. workshop. This program,’ ai by. the- Research 
oe 


we 


"Ment of Education of the Ford Foundation, was rst conducted during the 


summer. of 1966 in Bethel, ‘Maine, ana ‘continued a number of years on 4 = 


» self-sustaining basis. , : it aan = - ‘3 
ERIC - 
ANI 


a , 


Training Branch of the U. s. - Office of Education’ and the Fund FOR Advance- 


. at oO The NTL. training program was friginalty 4 fesignel te 5 amprove,aitication 


by providing: Linkage agents s\for ied ‘diSericts. Havelbck’ 4 review of 
e 


; ae Miterature ‘eéncerning . owtedge utilszation models appropr. 


educational “Innovation “(196 ) further clarified . the role. of linkage me 


aeunke. “Havelock concluded that uch: 2 role ds. erit, ally needed in. 
es 


F education’ and his, proposal that role ee need. ja - ksiowledge base# 


closely parallels content er the Nati ve Tr. ping Laboratory’ s. ‘program. 
The wm program failed. to meet. a a neefonal ie eed fox. training in | two. : 
~ ° 


ways. First, the: sfaining design was  exbloratofy from year to. year. as, 


ate needed. to. conduct chis: ‘type of canes they, could not be 


idea ‘Or, atned: rapidly enough. ao yt “4 ea a 
‘ ‘The developnentwet PETC-I ery: in Decenbér, 1968. ‘The following | ~ 


isa summary of major field trials and Fevistond to aate:* 


December 1968 through ‘Jurie 1970 ‘The development of a prototype 


of ‘the instructional system antl -its pilot Recing were completed. Pilot : 


. trials were conducted’ ‘in. Seattle, Washington and pou iuua. Oregon. r 


. July 1970 through April. 1971. Field ‘trials of a revised version 
July 1970 through April. 1971 | 


= 


. were conducted by. developers at Menucha, Oregon and Spokatie, Washington, - 
with: 34 and. 10 participants respectively. Developer observations and. 


experiences: at the iad sités plus participant reactions obtained from. . 


of 
. 


2 postsession questignnaines Provided data’ which, led te. further revisions. 


2 
‘ 


a May 1971. through siugust 1972. The revised. version of the instructiona, 
4° oe 
system was “used ie senior, evbineite ‘other than ‘the developers. The‘ - % ‘ 


«a 


followigg is a List of opeiaen which were elas ao = ‘é 
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‘ ee . : é Lh ree: . . . . , : cise ‘ e . : = ts 
oe Ae are a: 47 ge a eG rie . . - T : ao 
eo ° i a / ae ‘ ae ae; — = : , ’ y : 
eo ty gO SN Up. No. ‘of:. No. of No. of “¢ 
ee a A sentor™ =. Skills © GPS. OPS 
, Place ‘~~ : Trainer s) - ° [Trainers Groups Trainees’. 
ge . = ; : x ° Te f os z . z ; ie 2 
~» Brookings, S.D. _ 11/72 %. oghran:: a ae ey Ot 
Billings, Ment 2/72 Lg. el, B. Ward » 12 a: |: ee 
Seattle, Washington “, 4/72; «Be ‘McGlone C. Harper 15 4. ‘57 ey 
Corvallis, Ore. ..... 5/72. We. Hill. , fe +a Be as ‘24s ae 
“Minneapolis, Minn. i ae ¢ Bs Ward, B. Mil13 ~ *30 ® ll. 199 8 
Cee eR ee, . Fs ars: oa ree 
ee foe - cae oo eee S Ope ae, ca ee 
. _. - The materials and instructional strategies which comprise PETC-I mee 
: te ae : : eM ; ; oO : . * - > Ne 


a 
aed used during the following iserd case workshops: a oe 
| a No. of - No. of No. of a 
. a be Seniot.: ..° Skills #& GPA | GPS” 
Place . e ‘Date Mmainer(s) = "Trainers - Groups, " Tgajnees, 
‘ ore : = aes acre o 3" 
Mission Viejo, Ca. E 6/73 =. M. Rieff. 0 ae 32. ee 
_ Minneapolis, Minn. 7/73 | ‘M. Hendrickson |“ 12 ...- ae 43. + 
| Minneapolis, Mitin. . . . "2/73 R. Scobie. ~ 1. 16. ee: re 
Portland, Oregon . . 8/73. ° A. ‘Spanjer.-. | ~ 12 fs 63 ~~ 
| Seattle, Wash. © = —-10/73 “' -B. McGlone, .A: ‘Kolb: 9. tag 
Cheney, Wash. .- ~~ 11/73 D.. Gaudette, P. George 13° 
* gine Segk te" 7 #3 - : 
oo ~ we HP oe : 
Evaluation o e eae instructional system dur’ d. test 
\ » 
reveated part? fcipants foun ene materials nerevone and seh. ey 


also considered th training to be worthutilte: ‘Furthernorg, part cipants 
a 
showed significant positive Ghanges in attitude towards, thenséhves”a “ah 


“Lamps and toward anticipated use of the learnings. Aiehaoge degree + 


coe of mastery of concepts and skills varied,. erataeee were considered to" 


have pe ormed satisfactorily ‘in five ey the seven | focal areas. TE a 
j : , : > ‘ . we 


‘technical uality of the Amstructional system was perceived ds. quite | 


high by: both trainees and * ‘trainers. ; = . 


Boe 2 oo | = 3 ‘ a ot 
. (|, # CHAPTER wo , 
a . ; LAN ig , 
a e =4 . 
. F 70 ey + ; ae 
‘7, EVALUATION ACTIVITIES AND RESULTS OF STUDY.1 - L 
ae: ‘ in . ; - om : me an ; : 


a In this ‘chapter > ee activities and the tesults of Study. ie 


are. Aescribed and disc eects wepiee Aieludes ‘@). the purpose of the nee gad. 2 


. sai @. the: evaluation questions nis “ the “study, (ey; ithe : = a 
a, inatityset Lope: + 


tle 


eS : 
a * ae 
a t a) 
33 ie 
: | ES 


‘ Spb the effecke of, PEtCAE' taftructional « system. on, on oH 
akeit1s trainers ‘dn. terms ‘of, io their satisfaction with and their. : . Po. x ee, 
és Smee a, ae 

“perceptions. that Pager is Televant, “useful bnd needad and (v) het 


ry 


‘iendwledge. ‘The stugy was. designed to" ‘compare. ‘these wftects among, three = 


oe groups with dst ferent prerequisites. the thiée “groups gre “formed” tar a 
i test jthe. importance: of the PERC-T prerequisites and: of ‘the efficacy of we oa 
i. Pere-2 -_ versus an “abbreviated, treatnent. : . : ~ ay ee -< 
at < 2 . ngs ow ue ee, e eee: See - oe 
EVALUATION QUESTIONS : Ds | i PS Oe ge 
Two evaluation questions guided aluation activities -and data ~. 2 
snalyste in Study i ™ ’ 
. wih 2 s. 1. ‘How dé the three fortis of;: eatment compare =~ Os 
af . din producing satisfaction £ nd. perceptions: of 
a a merevance, utility -and. neéd: in es, skills trainers? 
Se 2, prhree ‘forms: of: treatment: compare in 
A pwledge ‘outcomes in PETC-I skills trainers? - 
DESIGN a a a er eS oe ac “ 
A ‘three-comparison group, posttest only design was used. Group Ase . 
al was to include people who had previously taken both IPC and RUPS but who 
a - si 


” . ae ae Ho 8 - a a 


7 received only an abbreviated PErC-I treatment. to familiarize them with 


the, ‘PETC-I. system. The abbreviated treatitent= consisted of. a one-day 7A ia, 


t 


-- ra cae 


orientation session conducted by" ‘che: “deve jpers: of PETC-I. ; Instru Nional 2 


"a . 
activities consisted of (a) an: “overview and/discussion of. PETC-T, (b) an 4 


Pa 


- explanation on how to ‘select, sequence ‘and conduct skill exercises used’. 


_in GPS MOERBHOPS and (c): woe the trios of okie trainers to make - as 


4 


“anitdal plans. and to: discuss. these plans’ with the developers. baie B. 


. was to include people who had not taken IFC or. RUPS, but who pertletpared me 
—e- . : 
in the full PETC-I workshop. Group c was to. include these: who had taken 


a 


7 _ both Ipc and RUPS and who received a full week of vere-i training. 


“The posttest only design was used for two reasons: » (a) legitimate 2 
differences between Subjects in Groups A and B would. be expegted to. - 
occur prior to treatment because of differences in ‘training pecker’, 
and (b) pretésts would oy be reactive for subjects . in Group C as a 


. ghey would increase their exposure to the system. . 


oe : 7 F ' 


FIELD SITES AND SUBJECTS , fo - ra 

| The original evalation estat calied for ising. mailed ‘invitations 

. bs eect subjects for five workshops lates ehe United Besbes ‘It: 
was anticipated that at “lease 30 ‘subjects mous. volunteer for. ‘each . : 


_workshop. Volunteers were to be placed into trio “dltbject. pools on the - ; 


; "pasts, of qualifications: “Pool ‘One would include le those wi who. had r coapretea™ 
_ 


“both  prerequgeitis, IPC and. UPS, and Pool Two ‘would include those who 


steenye nen 


de fe 
‘did not Raye the prerequisites. From these pools, subjects were to be 4 
m/e - randomly assigned. £6, Groupe A, B, and c. Six subjects for Group A and 41 
% six subjects for Group C were ‘to be cardonly: assigned from Pool One. 
“Six subjects. for eroup B were to be randomly selected from Pogl Two. “is 
ee 4 3 “hey iting ®, 
“ey ee 2 - . EHR ae 


e@ , Tsao ge, ath Soe ; a - : oo: 
Gile 3 tee Gee ea wo eee ree 


ia = s 
: Ber ie he 


Constraints: in the field caused. some deviation from this design. 


. 
= ° 


“First, indtead of. five gia only two could: be secured in ‘time to conduct 


the ‘tests. — Second, a lack of Fesponse. to mailed Tavitations resulted 4a 


v 


fewer pabeieipants than: the original design had called fOr Because it 


oo was not possible to recruit e enough subjects that had ‘ech: prerequisites of” 


Sere anes Renee ener Baer Ss, Sos 088 a eee ine 


IPC ‘and (RUPS, subjects were ‘selected for “Grodps. rf and c 7 they met ee 
; of the prerequisites—-either. TPC or RUPS——not both. : ‘Third. scheduling. 


: constraints and. participant preferasites to work with. specific friends or 


x 
. 


colleaggay | prevented complete random assignment of dubject/ in P ol One to 


Groups A and C. ‘This reflects rene probleins associated ‘with implenenting . 


+ oar - 


i eepeciueakal ‘designs in field settings. Readers should recognize that 
o 2 the amount ‘of bias introduced into ‘the. giddy pecausé of this factor is. 


- urenown. Characteristics of the two ) sites and of the PETC-I skills trainers. 7 
. . ae a 
are described in hs detail in the wention that follows. 


- Houston, Texas 2g phen a 
Central otiey personnel of the Houston Independent Schop1 District 


‘toordingted. recriitment of ‘participants at snes site., ‘Special. invitations 4 te 


were extended to persons who were interested in prepa ng themselves to 


a serve in a cadre of staff deve lopment cratners: “To mee testing require oe 


i ments, subjecta awere recruitMd from the ‘two! ) previously descrited | . ee, tah . 


_ populations-—those who met at least one of the’ PETC-I prerequisites and 


¢ 


those who/did not. ‘ro _ 


rt a pen 


The choad district Prwided t the workshop fectlities and $4; 500 to 


arte nes: 


ies: _ Pgetially cover agnior trainer fees and expenses. . ‘The renainder of the - 


erainer fees and installation expenses were provided by ‘NWREL. The _- 
\ o Laboratory also Pe participants with the opportumity to “receive _ o 
4 three. units of college credit. through United-States International University. 
‘ dette “— | Pi my - : | “a s 28 _ 2 os 7 7 : =, : , 


. 24 > _ ‘ 2 te © 


“Vancouver, Washington 
NWREL and the Evergreen School District worked together to recruit: 


paredetante -at— this site. The. school. -ddstpiet, adapted brochures and —_ eee 

“application materials developed by NWREL and mailed these to selected . : % 
‘personnel in the district. who. ‘had been identified as having the PETC-I | 

~ prerequisites. Because. svergréen tunted PEIC-L. teBining. for. their . & —_ 


. school administiators ‘and, center office staff, most subjects came from | 


"this 0 Glation. . ae 
pop a 


‘f The NWREL.’ Office of Field Relationé assisted with rectutting sevacis 
who” did not meet the prerequisites by mailing invitapions to to all educators ey 
in the local county ‘of the ‘everreen School District a8 to pergons in, 4 7 
adjacent areas who. had previously expressed an interest, in ‘acquiring 

| | PETC-I training. ar on 4, : a, ., ae 

‘Evefigreen School Mhstrict prfeted space fot the workshop and two a .. 
of Peles staff assisted as senior frainers. AWREL ‘providéd three senior ‘. | 


‘trainers and che efaiadng materials. As in Houston, NWREL. arranged. for 


colleg¢ Gredse for participants through United States International cy 


v Pa a 2 


University. 
“Characteristics of Skills | Trainers — ie 


“A ‘Background Gace denice (Appendix. Cc), developed b ‘the Har ehwast 


~ Regional Educational Laboratory, was administered to “all skills trainers 


prior’ to PETC-I training. | Information collected from this quesionnaire 


<s included sey sex, age, , Secupation, years of work” experience; education of ————— 


¢ 


the eens and previous experience with NWREL mexkshope and Ae 


* 


_ group interpetsonal dynamics training. ‘Summaries of ° the background a 7 


PS - y 


; ek 
T ‘charatteristics of skills. trainers, are presented in ‘Table Le 
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“WORKSHOPS 


» Tnteraction ° 


: ba : 7. F 4 - : G = Table 1 a F . ‘ : : wo z wee 
ese Distribution of Particdpant Characteristics’ by Sites and Groups: : Skille Trainere®® 


0 | 31.6719 *2 


| posiTigN, 


Teacher 1-3 - 

Teacher: 4-6 —_ 
Teacher 7-9 © 

Teacher 10-12. | 
. Administrator _ 
Staff 


EDUCATION 
BA/BS 
MA/MS 
Doctorate 


PREVIOUS. NWREL 


iy 


RQ000000 on ., 


~SOAL 


ware 
80°. 


' Analysis 
; toquiry : 
Hi. Level Think, 
SAFE 
Conflict 


°o 


a 
SCS5GFOO0CO oo. 
FOSO0000 of 


OwWwWO0000 oo 
©2S500000 oo 
OMHKKOO0O of 


OCMMODDO0O OC 
e2Oo00000 


4No angwers (N.A. s) ge: included , ‘ . = 2 


a bihile specific tests of significance were calcu ated on ¢ @ background aa-ou Gece sae5 


should be p@inted out that because of the sampling procedures used in some cases, légitimate 
statistical inferdnces are often not possible. The tests simply emphasize the magnitude or : 
lack of some actual differences found and, therefore, are primarily of descriptive utility. : ve 


“chi-square. analysis ‘used only the figures for IPC and RUPS and was only done ‘for: Groups ' Ace. 


versus c since all values. for Group:B were zero. © | fe 
o o> ; 3 
- - , 
: , 
7 : mi 1 
°. "4 oy 3.0 a 
vw a 7 a 
21 
ce ed oN eg ee x... 3 


rasa a ER : j 


Under 25 

- 25-34. 
35-44 

. 45-54 
“55+ 0 


OFWUMUO 


POSITION | 
Teacher, 1-#* 
Teacher 4-6. 
Teacher’ 7-9 
Teacher 10-12 
‘Administrator 

StaFf 


5.59119, 


YEARS EXPERIENCE 
Wo 

5=9 

10=14 

15-20 

21+ 


4.3324 


’ EDUCATION 
BA/BS, 

MA/MS 

Dectorate' 


"881582. NS 211271 


‘ PREVIOUS NWREL 


= | WORKSHOPS - 6 
| soar 1 .6{1 2 8 
Interaction 1 6f1 B 4 

Analysis ea oe 

Inquiry 0 O07;.0 O|0 ' 0 0 0. 

Hi. Level Think. . 0-0;0 O]0 0 o* 0. 4 

SAFE 1.0 OJO O;O oO’; "oO oO; 
Conflict - -0 0/0 072 . O 2 8 
y- 16) 1% 641 4 2° 8 
: 9 56;0° 01|8 46 - 6° 25° 
14 88}/0 oOf8. 6 11 °46 
0 o;1 £6721. 0 2. 8 


m7 : : 
“chi-square ‘analysis used only the Fegabea for IPC and RUPS and was only done Foe Groups A versus Cc _ 
since all values for Group B were zero. . r) 


ne —fonteequass analyaie sand onlyaftguces for *Siaft, sdniniatrator," " and. jotta 10 Re. Ce 
“chi-square analysis excluded figures in the "Doctorate" category. ath Hey Oe 
‘chi-square analysis excluded figures for "Teachers 1-3" and “Teachers hn6,° a 
Schi-square analysis used only the figures for IPC and RUPS.— L eo : gp 


~ 


e. i Statistical tests were conducted to ideiitify significant differences. 


Qo. 
ERIC 


ee ; : ests ; —_ 
between. the: treatment groups. at each site, between The treatmént groups 


_the two. sites|conbined. and between the two. ditas “with the treatment is 


r A 


= 4 
groubs comb#fned. le ‘tests reveal 


he 


di Eocene go omy two- “characteristics: 
sex atré ition. & Chi: oo aa 8 owed the Group B at Deel aael had a 

oo significantly greater, p percentes of fenales, than. did Groups A nd c in 
that gite.. Also, the Houston’ site combined groups showed a significantly 
greater percentage of females ‘in: Group. B than did: the « combined ' ‘groups 
at the Evergreen site. A Chi square aIso revealed g ignificant difference’ 

in the distribution ee: educator’ roles at the two fi Evergréen . 

participants were predominately administrators (73 percent) whereas. the. 


greatest nunbér of Houston participants 5 were in the "state" category , 


+ (50 percent). a 


; viet 


‘Workshop participants in the ade and sites edte not - differ 
- significantly in the other four categories age, years of work experience, 
education and previous NWREL workshops and training. ‘The ages of the 
participants were fairly evenly distributed between 25 and 55. overall, 
ara chese=querrers of: the participants had either ‘one to nine years | 
experierice or ten to fourteen years (37 percent and 35 percent respectively), 
“The vast majority (72 percent overall) ‘of the participants ‘in all treatment” 
groups e&cept Bivergreen’ 8 ‘Group: B had Master’ 8 degrees. “Prior, _ a 
exposure of participants to. NWREL workshops was ise cana “with the- | 


& exception: of the IPC: and ‘RUPS training retjuired of participants in 


es - 


Gropps ‘A and Gs eo. . : ee . — ce 


| {INSTRIMENTATTON 
- 8 ye ‘i 
Two instruments were used to collect information in response to the 
‘two seavisyuiyvetcced “evaiadtion questions. Items on the Final Sone 


> . re got é ; : . ou pes 


2 fern ; : : 
> ; = . woe = one: 
Pe = . x Es: j wo 
Ba *. ‘ . oe 


oe Gppendix D) were presented as rating scales with six (in 


. 
soute cases five) choives between a positive and negative ‘statement. For 


rd 


= "example, : Teeth 35. reads: 7 
pee pitas aed Fon ng 


, Wout you recommend ‘this pce tees toa a friend: 

* whose interests are Ltke youre? : 

- Definitely ‘not 
recommend 


Yes, cece it highly Ai! ae ae ab _/ 
. 2 _ Responses, were. scored “with six (or five) as the most positive and” 
x am . ' : N} a 
a score of one. as the. most negative. es i 2 2 a a . om Vs 


ra 
aw, 


oThe Knowledge Test (appendix E). for skills trainers wag. ‘developed 
“to measure understahdings of the’ meaning and implications of particularly * 


important ‘concepts: taught in the instructional system. This: miltiple-_ 


choice {nstrunent was developed through two phases. First, an open-ended 


aa - ’ test severing ‘concepts 7s the training materials was _ given to ‘participants, : 


~ 


at ferc-r wortshops Sonducted if duse and Suly, 1974. "Sécond, response: 


ae categories were “constructed from the answers given to ‘the’ open-ended 
a z as 


questions. From this. ‘item pool, preliminary version of the multiple- oF . 
choffe test was developed and again pilot. tested. Item analysis wea : 
after ‘this. test deternined which iteds to. Keep and whitch to delete.” Face 
- validity of. the instrument was established by, thie: judgment of the system 
| developers, senior trainers and evaluators. This analysis resulted ‘in - 
e 


a 49- -item test witch was, adniniétered ge the PETC-I skills trainers after: 
3 a 
they had completed their trainiag. me OS es 


: ot RE ULTS: " SATISFACTION. AND. PERCEPTIONS OF RELEVANCE, ve NEED _ 


cent nn a ne eet ae eet ae 


. Three items on, , the Final Questionnaire assessed. _the overall satisfaction 
ny é 


of trainees with PETC-I craining. specifitally, each trainee \ was asked | 


3in the process. of coding. data from the Knowledge Test, ‘it was : diaesverad : 
that Item 9 had’ two icactaraats dorrect’ answers... This item _thus was deleted 
' from the test. ht oe ae a MG 


eo tee, Se 


| tralia experience, ' ity 


‘f iutraely valuable 


4 Litle aie 
- No. -Tesponse 


tuatio 22. 


"| Yow that the workalo fa over, -] 


how would vou sum up the 
experience? . 


6 Brtenlp vote 
3 


a 7 very worthwhile 
4 No" aro . 


; Question 5. 


ee you cant this work: t 


op to 4 frlend wpose inteceat : 
are like met 


6 tes, recomend, Ny Me | 


| ! Definitely not recomend E . 


ON retpoage 


- 


Aten nny, Parent ai tes Heaps — 
For Skills ‘Teatnere' fafatactin, Workshop ba : 


tale a : Le es > ; ; 


‘ ; ots 


“Mhow valuable and how worthwhile ‘the workshop had hee ‘and if he or she . 


aaa ue cad at, to a friend. Table 2 pees and compares the = responses 
oa of skil}js trainers from Groups A, B and C. to these ‘three items. . oo 
te data-in“Teble -2- show- that-respondents: ‘go rexpenieneed PRICE 
. ‘training, reported high satisfactions. At least, .80 percent of one subjects | 
rotons ip aL three groups: marked the - two ‘most Positive Se on .- che seule on a 
: gti" three, {rems. Differences’ between groups in terms ‘of means “and - 
cumulative positive responses are slight, although croup C appears to. 
- result is a slightly higher percentage of satisfied participants. . 


Fe 


“Skills trainers ‘rated the relevance, of the instructional system on” 


ay Final Questionnaire items. They were asked if une: ayecen offered — 
- new tiisights, spoke ‘to vital concerns and if the: materials maintained git Ge 
tHeir interest. Table 3 presents nae compares. the responses of skills 
trainers ‘trom Groups. A B and C to these three items. . | 


bes H ‘The data ‘in Table 3 show that over 60 percent of the skills trainers, 


va 


“ga ed 
nafked ¢ each item in, the £0P two: ‘pontcive: categories. However, some 


variance can be obgerved- between, items and. bétween: dasaianll At least 


viet 


88. percent “of ‘kills trainers, regardless. of group, ‘felt. the system 
‘{ maintain ‘ their interest, but a 69 percent of respondents in. croup Av 


pee the. system. apoke. to vital concerns. and oe 64. percent. im Group B 


%e 


Fi? salen that the system offereddnew ane Ee: tt appears that Group B 


"produces the, highest. percentage of skiils-trainers who perceiye. ‘the 


"workshop as relevant ‘and that few. 1 differences: appear between Groups’ A and c. 


"Skills ‘trainers indicated their poveantions of the utility of the 
knowledge and. skills presented in PETC-I on three. questionnaire items. < . 
- ‘They were asked* to decide if the ideas and skills could, Pe used. immediately, 


i. 
Af the system provided real help for actual work ar how extensively they 


ye 7 


planned to use the ideas, skills and materials. . Skills: trainer responses - 


: to. these questions and’ by: condition are eunnarized: in ‘Table ‘4, 


y “ tne “ee > 360 7 7 - . -_ 


1 , * ‘ on + \ wan f 
eG Yo ; . : : F , ae 
: : i ! : : 4 ‘ , . on <t ‘ ; . a i . : pL % — ee: i 
poe, - ue i , : a a ae : - She ta, 
F ; z 4 ‘ t os : eae ar Ce hae Moa + 
‘ " 


Ireguey Distribution, Pernt wi Hoan citi’ ; us . 
i a ” Tak . ‘For , i" es eke fe gat 7 
(es i; ve ‘Skills treet Perceptions of. Relevance y cid tow ae i 


gn te crt “ hus pas eeb ligase ee eae a a ee ee rtm itn anne 


\ n mn " 
7 | - is Icroup AMAn{PRIC-I with JPC/RUPS “I Group B Pog vithout "TREE Group C PRI-I st = POS a 
SMREEE Neen nena “Aon 
—_ ee Fk, ercent 5 or 6 
| Question a3" ‘ 


6 Offered new inalghts, new ways |. 
.of viewing old probleas” 


Sd 9 -- iu 


1 only restate or er = 
already know ° 
0 No response 
| question a 7 
"6 Spoke to Anportint issues, 
He conems- 


1 Mieged the twit: {esues, 
vital concerns ; 
ON responge 


"| question Ba oy 


ary a re a 
3 
at 
dl Material faled to fa x] 
- ON response. a 


1 a 
Syeationd Bi Think for a, moment about the inforaationel acu practice ie scl ‘methods used dn this vi i - iil, 
how _ you rate _ come ONE BOX WN BACH’ fea . Poe 


if ‘ 7 * wo 
3 eu ca 
ee . 7 . . é > 
sj 1 . . Rs . ~ . : we @ ae: is 1 ; 
wales E Ic tae & oF . Ce ae ee “oe Bae ya LP ta a ye ait ciwe a, ane SOD ie 00] ev LST SRS Cee Go eC 7 RET BLE PS tek 
‘ ' ; as , aie, 78 a has i Z 
wack . i : E : a : F ao D Tall gs ce! 4 . ac: 
: , a : 2 ee eg 4 >t et . esa ae fe a us : an a Dae 
ee ail ut mo eo, . pa eee roe : kh ae atl : . ‘ ae 
, es a ; : ‘ ne eat ass Y a Me gt nS - 3 fs gt. ¢ = Re ro Bye Bete Je ‘ : fs i apscee 


“et a gue aay em wl ‘in a os Ne : Pe ee. oe 
a 3 Peg, bet. eae : stay | 
fl i sulle Traini! ate i iy y rat Groups 1 cei. ee 
—\— nen nineteen nna hn —— it Co ee eae ¥ 
\ ' ‘ : , “y : f A Re Ae oe M ae 5 ‘ . Me 
Grouy Vt wo Ta | reup¢ mcd with Tres ee 
INS NOAATA | 
' ao. pe OLS Lert ~ 
: ® Nee a | | ee lees T | 
| iO Tdgaa, skille methods cay be 


oan ra) 


tas | 


. 


, Used {mmedtately inder endatia 
condi tOna 


5 1 ne \ 
4 

3 

i 


1 Usage would faite changes da} 
conditions that I have no 
control over 

O'No response 


(uetfon af" Ho 


6 Provided yal "how to" help for i 
‘my actual. group work is 


j | 
7 7 ) 
‘4 ; : we 
2 


1 little hoy to! help for ay 
actual group “ | 


7 i No‘ ‘tesponse 


, uestion Ef big? 
i Bteehely 


| 1 Mot at att 
_ 0 No response’ 


Ag would yourrate thea? (CHECK OE BOK TH NCH LIKE) ) 


Muoation B In all honesty, how mich do you is to use the i al ale uteri real , ti th as a sega 
part of your work) _ iF 


Ie se 


ee “Hestiin B: Think for a moment about the informational wir, ese cucio wi netods used i thy wri. a fn ay 


fe tig ¥ » EY g pode 
1 . . 7 ' to ¢ is : ; : , i. sea ; . eg a ae 
a " : : i g . i , 


‘<) 
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( 


; “hie pérceived the. workshop ‘as useful. 


- ‘e 
x : 


ry 


On all items, over 60. sPOEceRe of the respondents marked ‘the cop two 


- positive categories. Differences betwee Groups A and C are slight, with 


it inpobevine that Group B produced the highest peréentage of participants 


- : © 


Finally, skills trainers inddcaced their perceptions % the educational. 


$ & 


- community’ ‘need for PETC-I ‘skills and the porentiaY of PETC-I for tieeting 


such a meas on _two items on the Final Questionnaire. Their responses. 


s 


os presented in Table 5. 7 ' wie 7 - . atan 


‘Table 5 shows that | over. 80 percent of skills. trainers in all ‘groups 


; _ reported ehace was a definite or some deat for PETC-type skills: and abilities’ 


Q 


They also felt the PETC-I inatructional system had excellent or good 


potential: for wasting this need. It appears ‘that croups B ‘aii Cc. produced’ 


, skills ‘trdiners who see this. need and the eres of PETC to fulfil} ft. 


‘ slightly better than Group A. a ; ; . —— 
” He ee * ie 
* To make a clearer comparison between the three groups according to | 


_ the criteria of skill eae. satisfaction ond their perceptions of relevance, 
utility and need, the percent of respondents marking the t two Sesponse 4 ie 
categories fot afl ditens 40 a-cluster was averaged. These data are presented 
inTable6. | ty nr Eo 
The data in Table 6 show that, in general, a smaller percentage of 

skills’ rrainerg in Group: A markéd enee two categories of purses , 
satisfaction, televance, utlity and ene for PETC-E skills aad abilities | 
cian did skills trainers in Ground B and C and in most instances, the 


« . ah : ‘ 
differences between Groups B and C are slight. The differences found 


- between Group A (MiniPETC-I treatment) and Groups By and Cc on perceptions 


of utility may suggest that a minimum exp@sure to PETC-I does not produce 


as high a level of satisfaction and ‘perceptions of relevance, utility and 


need on the part. of particjpants, a as does full involvement with the 


iaueeuced saa lscye oa: - 44 ; 29° 


; a oe “tans ore 


- equa hen he w Hasn ut “Foe, ey a 


| UN. _ | “ Sul a co om ims Ba a | 


apt: opin 7 
a Ve riga 


. (ueston oy 
| ble 


( | Ho reaponse 


. { , ; : J ‘ 
' i ay ot . : ; ; . | | 
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oo i ; ¢ 
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y tee inh se = ‘Table 6 


Average Percent Marking. top Two categories 
For Item Clusters by Workshop oe 


sverstiatinn 
Relevance 


| Uealaity 


Needs 


RESULTS: KNOWLEDGE OUTCOMES = e. «pt ee 
The second evaluation question of ‘this neady focused on whether 


t 


— diffeent forms of treatment, influenced knowledge gutcomes of PETC-I 


skills trainers: The previously Gescribed Knowledge Test administered 


* to trainees at the coneltsion of their Srene was used ‘to, measure 


this “Vatiable. . s 

Before analyets was, done to resendiia differences between the: three 
seoupey -e-testa for independent danplen were performed on the means in | 
order to determine if site differences. existed. The mean scores ioe 


all respondents at the Houston afid Evergreen sites were 11.63 and 12.5, 
. : aa f 


respectively. This produced at of 1.01 (dé, =43) which was, not » ees 


acattertrally significant. Because no differences existed between. sites, 


scores were combined. € 
% 


Using the ‘total scores frok the 48 items on the Knowledge Tdst, 
means for the three groups were eae and submitted to an alalysis 


of variance. Table 7 displays the means for the three groups and the 
analysis of variance of these scores. ; : a 


a 


44  /3 


cd 
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Between Groups 


‘Within Groups 


Table 7 - 


; Analyete: of Variance and Mean . Scores on a ee 7 -_ - 
- PETC-I Knowledge Test for Three Workshop Groups 


Mean | Mean Scores, 


Source 


Squares} d2_) Squares | __F __ 
————e ————eooooooeee 


Total 


foot, 1 * 


These data and the analysis of’ variance between. means. Showed no © 


‘significant differences among groups. ‘Reasoning that the lack of. 5 


' differences may have been due to "error variance frou, the uaknoim internal, 


‘consistency of ‘the test, gdaitional analysis was 9 performed.” 

Using the scores from PETC-I = trainers in the study, the G . 
intertal consistency (Cronbach' 8 ALPHA, See Nunnally, a8), was calculated: 
Items that correlated: low with total scores were discarded. Total scores 

. for. the venaining : items, were recomputed, and then internal consistency 
of the instrument was recalculated. | | 
7 Using the, 48 items, the ALPHA equaled 6, a relatively low value | 
for a test with this many. items. The new instrument useg in the analysis. 
consisted oF 17 items from which new total scores and ALPHA were calculated. 
The new ALPHA was .78 which ig ‘considered acceptable’ for a test of | this | 
léngth. Items were » discarded if the original item-total correlation 


me 
was less than 2e 


2 


Table A in Appendix F dieplays the correlations ‘between’ original total 


scores and retained items ged new total scores and retained items. Table Bo 


in Appendix F shows the item-total surretations for the Mtacerdes items. 


32 


» 45 


. “Using scores: from the 17-tten_ stale, again analysis or “wariance was 


perforned, and as can be observed om the data displayed in Table 8, no | 


- significant differences ‘ationg roups ‘were found. : 


Tab le 8 


ee . Analysis of Yartance and Mean Scores” on Se 
' PETC-I Knowledge Test for Three = Groups i é 


ee of Variance 
"Source 
Between Groups |. 29. 94° 


Within Groups 355,97 


385.91 | 


o weet Laan attéfipe® fo” “expldta- the- rack SF ad fterences anong groups 


. in regard to > participant knowledge. SCORES) one final analysis was condust ed: 


1 


Each item’ on 1 the knowledge test was examined | and the. percentange of - 


_% 


participants in each group who © answered the item’ correctly was compared... 
- a 


Again, no striking differences were -obsepved. These data are s displayed 
é 
in, Table c in Appendix F. ; ° 


a 


‘Te appears from these enalyses that the amount of PRaOe training in. 
NWREL systems. or the attount of treatment’ in a aes iteself does not a 
“tn fluence the amount of Yenowledge accrued, at least as measured on the 


r Knowledge Test. . Further discussion of this finding will be Svacusded 


.-. dn the final chapter. , A S|; 2 é _ 
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“4 EVALUATION ACTIVITIES AND RESULTS.OF STUDY 2... 


In this chapter the evaluation activities and results of Study 2 are 


~ 


: described and discussed. ig ty Chapter. ‘Two topics includes: (a) the® 


purpose of ‘the ‘study, (b) the evaluation questions which guided the 


of Se 


os studyy (c) the résearch methods. dncluding design, sampling protedures, ie 


- instrumentation and. data naaivee ‘and (a) ‘the ‘results. ° 


. os oa 
eae ee egies he 
r 


"PURPOSES OF sTUDY 2. a eat ae a. Be a, 2 aoa os 
: oe Re, a BP gh * 


‘This study compared the effectiveness: of skis trainers in Groups. 


A,B and Cc described in Study 1 to produce fa) sat sfaction’ ‘in’ GPS erainees, . 
a and their perceptions of ape mee, utility. and need of the,” ‘training’ and - > 
| (b) knowledge, outcomes ‘in GPs trainees. rae EC. i ee i 
: > 2 ae or :: my tse 
_ EVALUATION QUESTIONS a Le eee et 


Pry, 


“two evaluation questions listed below, guided the analysis in oa ie 2.4, - 


1. tow do: skills trainers oo the three treatment: 
‘groups compare in producing satisfaction and ps 
perceptions of relevance, utility, ‘and need. in 

“Peeetcipante of RS workshops? me ae >. | 

oe. = . 

2. How-do skills i paghets a the three treatment 
me ae groups ‘compare in producing knowledge outcomes | 

Py? ‘in ao of EPs workshops? -_ age F 


iim . . , -. f . . . 
' . € 


DESIGN . Doe 


Prior to the GPS workshops,. the skills. ‘trainers’ ‘taed: in Study 1 were 
9 
“grouped into three-person training ‘teams: inbuch a Bay that each trio 


was composed of: Say subjects from - Groups: A, B,: ‘or: c. GPS participants 


Pes 


_. were then randomly: ao. co: each of: these: trios. 


ce 
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as. criteria to Measure ‘the effectiveness of the three groups of skitis. 1 


each site are eeeri bed in the sections that follow. 


Vancouver, Washington GPs 4 Fo 


oe 


Satisfaction « and knowledge skills of. the: GPS: participants were used’ 


- 


4 


Ee hiciets As in Study 1, a posttest only design was employed so as, to 


“prevent pretest reactivity, . a Bg” ee i aan 


es eno 


FIELD SITES AND, SUBJECTS oS ee ee Be 


‘The same attes. Houston and Evergreen, were ‘ised for ‘this study. 


_. Recrudtment Procedures iad characteristics” of the” GPS participants at 


%. i oie We, 


Houston, Texas GPS 


ry 


“Recruitment of - GPS subjects: was coordinated by school district 6 


personnel from Houston: “‘They- mailed brochures and applications prepared 


by NWREL to all teachers in the district. When this gesulted in an. 


| insufficient response, ‘hey also. requested ‘teachers from. the. district’ s 
"Magnet School Project" to participate. Subjects were randomly assigned 
to workshops over the three. conde tious of the study. Although, as in 


the case of che PETC-I skills ecadaets: subjects" requests to ‘be in os 


moxbaheps with ‘friends’ or colleagues were honored. _ Undoubtedly, this 


L. 


introduced ‘some » bias into the various: trajning ie but ‘the, exact 


amount is unknown. a8 , . 


The Evergreen School District.provided NWREL a mailing, list of 


éducators ‘in their district. and. the surrounding area. Persons” on. ‘this 


list were invited to participate in GPS workshops | cheoug? mailed 


invitations. Agein, ‘because. ee response, rate was insufficient ‘fof the 


etiey.. informal word-of-mouth recruiting also sceurted: As in Houston, 


subjects were randomly assigned to workshops gua some deviations were 


allowed: 


36 


48 - 


ven “Characteristics of ops Participants. : 


te "a . " Recruitment at. both Houston ond: Vancouver. yesulted in fewer subjects a 


than called for by the design. only, seventeen groups: were | assenbied and & 
some: of these’ lacked one or two persons from the recommended working 


size of twelve persons. ¥. 


bee ae es 
“Information sollected from GPS subjects) at both ‘Houston and Vancouver ee 


t 


with a-Backgro ound Questionnaire (Agpend¢x . are displayed dn Table: 9. : os 


. The background characteiaticg. ef GR participants were » analyzed et 


using . the same statistical tests t as, was used foe the skills Sy 


trainers’ data, A chi square sho d cr. to: be’ a 4 significantly greater 


“4 S percentage of female cubjectefat. Sports ston site than att Bvergreen: Pa See 
No significant differences were. Giscoveres in any of ‘the other 

aa Subjects in Evergreen tended to be srighety, younget & than” 

4i5Ka at Houston; overall, hi percent: of. the subjects were evenly, 


"distributed between the ages of 24. ‘and 45. The ‘GPS groups were. ‘made, up ‘ 


primarily of teachers (76 percept @ overall), although: the greatest 


{3 


percentage (36 percent) of sub ats in Evergreen! 8 Group A were in 


ae the "stage" category. The ‘worl experience of GPS ‘subjects was fairly gs 


evenly spread between one and feenty years. However, 73 percent of the 


, ~subjects in ‘ile three sets of. Group B skills trainers at Evergreen had a 


. to 9 years, while. 76 Garcedt et the subjects in Group Bat oe 

* had over ‘9 years exoeiwnce: The dajorsty (55 ‘percent) of thé’ subjects: 3 
had bachelor degrees FAEnEE than, pecguute degread: although nearly | 
three-fifths of the, subjects in Group C at both sites had “graduate degrees; 
predominately mantei's degrees, ia penecal previous ‘training with 


a 


NWREL workshops was! minimal. ; 5 ; ae . - 
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Se ners hog oan e TT oe ees te = ie 
. ¥ : a tate ete ae eee Senet ee sab cbhgetdans iit og eed 
ie - ; 7 ve i 
= : : Ba. er a ah ee : we e vane. Y 
. : mee 2 ese de tn Se oes 
Distribution ‘of Participant Characteristics: GPS aaa A SP tg er 


ee 
has $422 -71)18 se 1. 9679 

p3- 46) 9 29/12 : 
c 


. AGE a 
- Under 25 
- 25834 | 
en ee te 
: 45-54 
; 55+ 


POSITION . | a a. i oa ; a = 
“Teacher ‘1-3 1.72087 6° NSH. 8 ; . 
Teacher 4-6 ? 
Teacher 97-9 . 
Teacher 10-12 . 
Administrator, 
eStaft 


: “YEARS EXPERIENCE 
- 166 
5-9 
10-14, 
.| 15-20 
j 21+ 


EDUCATION 
BA/BS 
3 MA/MS 
2 . ' Doctorate 


BREVIOUS NWREL : ‘ ‘ - = wg 

WORKSHOPS : ; - ee i . 
SOAI < . 4 : on 
Inter. Anal. a. 
‘Inquiry i 

’ 4 Level Think. 

*. SAFE 

Conflict 
Influence 

oo, Irec ¢ 

B®  RUPS 


ermooo0oan 


OCOD CCONG 
eooogoooOoNO 
lorooooo0o0o 
oneoooooo0e 
Ww 


®No answers (N.A.‘'s) not ingluded. 


. ‘ bynile specific tests of significance were calculiaved on the background. and outcome , data, 
it should be pointed out that becatise of the sampling procedure used in some cases, legitimate 
statistical ' inferences are.often not possible. The tests simply emphasize the magnitude or ae 
lack of some actual differences found and, therefore, are primarily of descriptive utility. “ 


° 


“chi-square analysis excluded data for "under 25" snd "55+! categories. : ; 1 ; 


‘ 4chi~square analysis excluded data for "teacher 7-9" and "administrator" Saree at, 3 
“chi-square analysis excluded data for “doctorate”™- category. : ; ; 
ate fchirsquare analysis used only data from "SOAI, Interaction Analysis, Influence, IPC and RUPS" 
categories. - . ; : . 
38 i + : on . . . : : é ? : 


. . Sites ‘ 
(Combined Groups) 


POSITION 
Téacher 1-3 
“Teacher 4-6 
Teacher 7-9 
Tescher 10-12) 
Administrator 
Staff 


4.5626 2 


Doctorate 


PREVIOUS NWREL 
WORKSHOPS 
SOATI 
Inter. Anal. 
Inquiry 
' Hi. Level Think. 
SAFE. . 
Conflict 
Influence’ 
TPc 


HPWRADOO 8 
NVUWODO ON | 


“chi-square analysis “excluded data for "doctorate" category. : 7 
fo Chi-square analysis used only data from "s0ar, Interaction Analysis, I zatteenet TPC, and RUBS" 
categories. ~- ~ . eo 2 
8chi-saure analysis used | only ‘data from "SOAI, Influence ,;:IPC, “and aia categorten. , 
~Pchi-square: analysis. excluded data from the {under 25" category. , 4 : b 


: on eo 
’ 
: . ag 


< ero : : Z - 5 ao a Bot ‘ . | 


ne 
fs 


o> cmsrauumiration BT 
Two insttuments were vsed.ge collect ‘informition, which ‘responded to 
. ame | * Bs a w 


_ the evaluation aussesans. J that Qutbetotnasre,Mippendix 8) similar tor 


bo PEYC-I sk i iratnare was “adninistered 
nist a a 


“using escentiatly the same procedures Seierinas earlier for ‘the PEPC-I. 


y 
| Knowledge fier. Using the original. Wy items, theernal. consistency | was 


4 - 


calculated which n produced and ALPHA ‘of =08 Gus Table A in 1 Appendix: 1). 


~ ALPHA wete ald pated: ‘The new ? ALPHA was 89 (sua Table A. in appeiix I).. 


Items 2 and 3 werk retained even though cheir iten-total correlatééns were 


less than Sd : The reason for retaining these iteng ‘was that. the value _ 
; . 
tera} colisistency index relies upon. test: ‘length. Ie, ‘was wage 
es, . 
believed that the ‘large sonphe size 170) would offset. much of. the ‘sangling 


error in the correlations. om i 


% F . ease “NX . i - : 7 
" RESULTS: SATISFACTION AND. PERCEPTIONS OF RELEVANCE,  EILITS AND NEED 


‘Since nese: ttens on “the GPS Final Questionnaire which were to. 


te measure satisfaction, relevance, tae and need. were identical ‘to . 
Wika, “those on the ‘PETC-I Final Questionnaire, they eager ae be described here. . 
Tables 10-13 present and compan he Zenponses of of GPS subjects who took » : 
mpareneee from skills trainers 1 the chres treatment: “groups for the 
“four éategories of items. _ . | 
‘ The data in tables ‘1o- 13 show that respondeiits who experienced GPS 
workshops. were highly datistied ‘and. saw the workshop as relevant, useful, 
and needed. _Except fore two itens on the actly category, at least is 
Rercent be respondents in all groups marked the two most positive posits 
"on all itens. me, c. yen a _ ag ae ae 
- | : —_ 
re) . - De os . : 
ERIC 


hegtion as 
| i My om need 


“t Wine | 
0 renee . 


nv the: aly ctr of tt wih, ya u believe 
? » there ig-a need: in tia’ educational ns for educators ea group process: ‘killa and. abilitieat © ee a con 
+ “Question G34 Pheage rate the potential of (PS. for neetin, uch # need titele Ones. pais : rr ee . 


: . im teats eG 


“Mil 


4 a . ha ey, reve ad wa al J 3 co, 


é. 
@ male! stu o it Gp 


‘en ny. | 
} 6 Bay wy, verte 


au ye vale, 10 Day 
rare Qh espouse _ “ 


b ! en nt Z ‘s 
7 ee verte ; 


- Not, very vortiidle : 
OMe reepowse 


eee 
| ;, 6 Yes, recommend. highly © 


"1 Dele not rom 
fl No reaponee 


“tueation nN: mt an overall isesment of your tradndng ett ws sit - MO 
a ato Fl: Wow that the srt cn ta over how would yi a the mein te ee oe - - fs ob 
ERICH a a Would ba rma tts vt toa frie a aera are ca yan ae ¥ ; : | a fi : 


 Ttueatton 23° oy 
re ae) Offered n new. tnaights, new ways 
4 o of: nee old cage 


a tly ieibat or sail vhat 1 
already kney : 
0 No responge 


7 Question Bi 
‘| 6 Spoke"to, iaportant. tomes, 
- vital concerns 


4 Missed the. cat ant i 
‘vital a 
0 Ko Tespong 


a estion wt os 
é Materdal nsintined ny interest 


1 Material fatled to intereat ne 
"0 No Tespaiie | 


Swuestion Br ‘Think for @ moment about the informational materiale, mci exeteloes and pethods: used in this varkshop All in all, 
p how would you: ratethet (CHBCK ONE BOX IN BACH AME) | 


€ 


: ryt et we ap See ee, a 
i : 3 4 so rte el » ty by — Group + < Se” 


5) 


a ai yo ha ee | eG 7 
oP Ideas akd ls nethods can be ; 189 | 67 ' 4a ie fa AS | gi yf 
used iumediately under exlotng| | ; ie | 


7 ciditlons _ : a _ ee © ms 7 
| Fl a6 | | Pane 
eee eee “pat 
| ts ee ace | ee 
ca] ocr vould requirg ey tn | 
= "conditions that 1 ‘ 
es se 
mm 0 No responae - 


"” TQuestiton wr. : qk 
p Provided real “how to" help for 
my actual group work 


1 Little "how to" help for wy 
"ac 1 group vork 
le OMe sponse 
ae ueston no | oe ee eo ee ee ee 
| 6 Ritenstvely 4% 98] 79.2 4-16 | 26, 92] 11.7 16 | 35.6 | 45 | 5.04 p 1546 
Ls, 88 as ne ae 1B P40] of. ) 
i} | ee md d)o-f of of bp ae as 
{oa i i is ee Te yi] ae 


aa i Bs Think for a mene about the informational iui practice cere and mits oe fn ths weg, Al) dn a | | 
5) “how vould you rate thea? (CHECK ON, BOX TN EACH LIke) 


one bhuestion By In all honesty, ° ‘how much do you ra to use the ad aldlls ade materials a in this wt is a sna 
ENC pat af your work? 


co 7 -When the pertentages of resporidents marki@ «1 the "top two response 


Tee categories for al. iene in a cluster were averaged, the following 


re “spatcern etierged ‘Group € consistently had the: greatest number. of partici~ 


ny eee os 


Pants. ‘marking ‘the top two categories; econ: ‘beat gas ¢ Group A. Group 5 


“always, did the poorest: This trend, dtapley d in Table 14 prompted ; 
“further dnalysis. 1 ; 5 


r) . Ape? 


cr ee |. Table 14 


an iicine Percent Marking Top Two Categories For’ 
Ttem Clusters by sorkaer Group . 


Ee Item Cluster. 


Satisfaction 


Relevance 
_—. Wo. 
aE, | Utility 
, Need 


Me Se 6 The open-ended items on the Final Questionnaire were eliminated as 

| were others that did not employ the 5- dr 6~point Likert response scales. ° 
Mae . ae . — eu. oe . ; _ 
ss - Responses for the remaining items were then summed and produced a maximum ° 


" possible score of (204. Item-total correlations were then computed with 
} an obtained ALPHA of 95. No items, therefore, were discarded. 
e —_ . Next, to determine if sites could be combined, Brelinsuery creas 
7 were performed on the means on. | the Final Questionnaire. ‘The ‘means, out 
base ofa possible, 204 at Houston and Evergreen were U7. 9 and i. 0, - 


_y respéctively. fhis produced a t which was significant at the .05 level 
= of confidence,’ but the population butioate of the proportion of. variance 
3 ’ in scores that is explained by djfference between, sites was ae minima? 
” (omega squared = .02 or: two percent of variance accounted for) that Lt. was 
decided to- pool the sites and: inspect differences between Groups A, B and C. 
. = _ . a LS 


e@ e 
E RIC i a oe 


. One-way analysis of variance on. responses to the Final Quesitonnaire 


‘showed : significant differences among Groups A, B and.C. These data and { 


analyses are displayed in Table 15. 


- ) - gable 150s 


Analysis of vavibueeand Mean Scores ‘- ° 
On.GPS Final Questionnaire P 
For Three Workshop Groups 


Between Groups 


ithin Groups 


jfotal 


The Tukey ASD post hoc multiple-range_ test: indicates that the major, 
; difference is attributable to the discrepancy between responses of those | 


in Group B and those. in Cray Cc, with. Group c ecoysng higher. Again the 
te : oe iy 
Omega squared is minimal, acpomnting for only two percent of the variance. | 


Essentially, no differences existed haewcen responses in Groups A and B 
or between those in Groups A and C. 4 


RESULTS : KNOWLEDGE OUTCOMES 


_ . The et evaluation question of this study. focused on the effects 
= of different forms ce treatment of skills trainers on the iaowledge 
outcomes of GPS subjects: To measure this variable, the previously 
“described GPS Knowledge Test was adninisterdé. to subjects at che Gone bust on: * 
of the GPS aaa ok et, . 
ig The | mean scores for GPS. subjects at the Houston aad Evergreen sites 
were 10.20 and 10. 78, respectively. . Preliminary t-tests showed these 


very slight differences to be. not ehentet casey so sites were combined. 


Table 16. displays tle mean Scores | for Grouse A, B and C and the ‘analysis 


‘ ' 


of variance of these means. 


eS, . Sua . % 62 . | 
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7) a _ 
- one-way analyeis’ of variance. ‘on ‘tesponses to ‘the GPS Knowledge 


Test showed no signficant aigterencés among croups A, ‘B and Cc. 
i ! able. 16: 
eee analysis. of; “VWatiance ‘and Mean arent a Sie 
— _.  . On GPS;Knowledge Test For. 7 
: ae a! Thrde te Her 


aria aad 3 : 


| Between Groups | 


Within Groups — 


Total 
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CHAPTER FOUR 


4 é $ _ 


ee . ~EVALUATION- ‘ACTIVITIES: AND: RESULTS: OF- ‘STUDY- 2 Sau Seana 
7 ‘In this chapter the evaluation activities and results of Study 3 are. 
described ‘and arecuned... As in the previous chapters, the format ‘ts ~ 
organized around (a) the purpose? of the study, (b) ‘the ‘evaluation question a 
which guided the study, (c) ‘the research methods including design, 


sampling procedures, instrumentation and dara: maatyets and (a) the results. 5 


PURPOSES or sive 3 — 
This study investigated the Ampact of GPS training on the classroom 
” ce1dmate for teachers participating in. GPs workshops. and compared: these : 
" climates: to teachers in a ont rol Broup. “The study was conducted in : 
epee math anothe® Improving Téaching Competencies Program PEoduce: 


aaa as Dnfluene (INF). 


EVALUATION QUESTION 


‘One evaluation, question guided the. ‘analysis ok Study 3. 
1. “Do students in classrooms where, teachers have been . 
' trained in. GPS’ report a more positive classroom’ 
.,  ¢limate than those“in classrooms ‘where peachers’ 
“ * +» have not been. trained?" oe 


DESIGN st 4 | ec 
A compentson group, pretest, posttebt design was used in this study. . 
i The two groups conee es included teachers trained in Grorip Process 


Skills (GPS), and (b) teachers receiving. an abbreviated treatment: (Control). 


‘Table 17 shows the. treatment and observation schedule. 


“Table ae ae 


Treatment and Observation ; oa oa 


a Se A. October Pat November 
| 197% P97) | 974. 


Target Group (GPS only) — 7 . GPS 


i ie 
are 
‘ 2 


Comparison Group. ae Bie ~ | One-day 

Aobreyieees ‘trediment) ‘4 -ortentation to . 

{| learn 7.) . oa 
| evalution | 2 ae 

‘requirements. . 


" RECRUITMENT, FIELD SITES 4 AND SUBJECTS ais han 
. a a x 
. The original denign ‘of Study 3 called for. the recruitment of. 108. 


; apes elementary teachers and their. random Agaiennant to one of three a 


treatment BrOUps. ; 


. workshop. A second was 2 to/faval re partieipants in a one-week workshop 


- 


ene. oF the treatments was to involve participants in’ a oné~week. GPS 


alee“ 


on Interpersonal Influence (INE). (another instructional axatin developed 


; by the Improving Teaching, Competencies. Program and thought suitable for- 


making cross-system comparisons). People selected for the third group — 


would serve as’ a control group with, the protiise of receiving 2 one-week 


‘ workshop after the study. was completed. 


THF workshops, the réqdiremeats of the atudy. 3 8 a promise for a a an 


“Recruitment began “in April, 1974. Brachures dedcribing. the GPS and 


- 


/ 
workshop for ‘those chosen to be ina  AdatroR group were distributed to: ee 
fourth ehrough sixth grade teachers in the Seattle metropolitan area. 


The reponse’ rate was: short of the. number of. Bub Ieces required for the. 


7 study, so biochures were again circulated in late ie cre” and early  & 


Osnebax:. aes Soo - 3 | 4 a | 


er Te 
se ee 


Prior, to the workshops, subjects ‘were assigned to treatments. 
Those subjects indicating a ‘Preference for GPS or INF were randomly 
_-assigned-to. one-of--these groups. ‘Those - ‘preferring the-delayed-workshop-7~: ™ 


2 were, put into ‘the control group. Subjects indicating no preference 


. were elles: assigned ‘to ‘the three group, with the stipulation that all 


“Pa. 


"groups have approximately the. ‘same ‘number of participants. By the day 


Dc. ‘the workshop, the required number of participants (36) had been . 
+o 4 
“ assigned to each treatment. "However, at =e meeting of the 3 groupe, 


us 


oe only 25 people appeared: for. the GPS workshop, 22 attended the: INF 
‘workshop, and 24 canie- ‘to the: control group meeting. 
During this time it, was discussed that eight, of the participants 
were: concurrently involved in poster TTCP _workshop. ft was felt that’ 


this additional training might influence the results go the eight were 


eliminated from the study. . 4 S _ aa as | be ae 


- 


“‘Doviae the initial meet ings with the three groups, subjects « were | os 


asked ne, name a person whd would be willing ;to aéninister classroom 


ay 


climate questionnaires to their students. During the folloving sieaig: 
three members of the evaluation ater. personally delivered a set of 


eiimate questionnaires cand. directions to the. designated test administrators. 


oy Questionnaires and instructions are described on pages. 151-169. (The ‘ae 


trainees and test administrators were asked - to admi ster. the . 
| ‘questionnaires by Ocboer 4, and send them to the evalua rs. as soon as 
| sponszele. Administration of the S qasee onaaates secured ‘in the subjects" 
"classrooms when. the subjects were not. = the room. ‘Administrators were . 
directed not to show the responses: to the suieasks and to mail the | 


questionnaires and responses inmediately. 


When the PEEPESee were returned, it was discovered that seven af the 


eke cess subjects did not_ have _usable data. Two control. group teachers taught as’ 
ERIC 
ale 


at 


‘a team. aca réturned only: one set i raueatcadatcess’ Three other teachers. 
who taught as a team had been assigned ‘to_ different: treatments and had 


_been. instructed not. to. return the _ questionnaires. _ ‘One. set of questionnaires. 


was never delivered, due to. > difftculties in locating the schaol at-which » 


i the teacher taught. | Two sets, of. questionnaires were returned without | -_ 


a 
any reacher. identification, aaking it impossible td assign a an ddentifi- 


4 cation number. . % : & 


In ‘late November, posttest gigekiounalves were sent to the test 


adminigtrators from whom. usable data had pene received. They were asked: 
to return the questionnaires by the ‘end. of the first week in n December. 
| At this time, the number: Be usable questionnaires dropped to 47. Two 
= 3 teachers were no ‘longer. pean ing the same group of students and, did not 


ee readminister, the quegtionnaires. One teacher, had Beet Rene a student 


9 2 


teacher moet: “of the time, so the data were’ not — Data from one ‘ 


s 


o 


. teacher were received too Rate for analysis. -Three sets of’ qicattonidaxes 


were returned without . the eeathae" s names and" could not be Yised. whe 


teachers did not return questionnaires. 


5° ’ 


oe 


"Difficulties ‘obtaining school aNprict permission to use one of the 


v 


climate ‘questionnaires precluded any followup on the nonreturns until 
rae ae 6 > 
P “late January. By this i it | was decided not to contact teachers: ‘from 


a whom nd ‘questionnaires: were returned since too uch time: pad elapsed 


4 


between the major testing. and the followup testing: . It was also decided 


% a 


not to make: comparisons between the three groups but . to compare the 


Interpersonal Influence participants to controls and aps participants to « 


controls peparately: 


Of the teachers from whom complete data were: esiteated and used ins + 
. # ‘ 5 
subsequent analyses, 16 were “in ‘GPS and 13 were in the control group. 


~ ‘ : sy . 


52 
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os 7 ; 
‘During the first training session, all subjects completed a 


Background Questionnaire which aakaa ‘what grade level ‘they » caught, their , 


s 


sex-and ages ‘their™ years” “of” “teaching “experience, highest degree ebeained: 


and reasons -for attending *he workshop. On the questionnaire, cubjects: 


me also indicated what other Improving Teaching competencies Program workshops 


they had attended. The | responses of the 29 subjects from whom complete 


Seiinate data tere obtained and used! iy this study are ._ptesented in. 


s 


‘ Table 18. 7 eT : 


reaily wanted to learn about the subject. 


It should be noted that most of the subjects were in their thirties 


» , - , 


and forties and had more than seven ye 8 of teaching experience. Few 


of the subjects had participated in other ITCP workshops. The main 


° 


reasons thé subjects signed up fgagthe workshop were that it satisfied 


v ¥ 


some requirement, that there was no-cost for attending and that they 


INSTRIMENTATION 
‘The climate inventory was used ‘to detect differences ia classroom ey 
climate. The questionnaire needed to be appropriate for students in the 


fourth through sixth giades, since. only teachers of these .grades were 


. : . 


included in the study. Zo 


7 ; : a? - 4A 


“Because it was not feasible: to develop and validate a climate ~ 


inventory specifically for this study, intact subscales from existing 


eoetemeate were used.. Existing instruments, were exemined and inventories: 


onsen were described: as ‘measuring classroom climate were reviewed on 


_ the Kis of whether they (a) ‘indicated Ginecs: teacher behaviors (Btnice 


teachers were the workshop participants) or (b) indicated consideration 
mat A 
al 


on the. part of teachers (e.g. letting more people talk in the ‘classtoom * 


or paying more attention to students’ feelings and aStivees) Initial. 


* 


a ee 


~\ _ =, Table 18 


_ - a a Background Questionnaire Responses by Participants 
. ; With Complete Climate Data -s 


: “Percentage of Participants 
In Each Category 


GPS "Control 
N#13 


Male. 


"7 Age ; a gt & ; 
. 20-29 "poe 
» 30-39 : 
* 40-249 - 
; 50-59 e 
: 60-69 
No'Angwer | * 
_} Grade Taught : 
: rp) 4th : , 
Sth. ‘ 
6th. -“ # id 
No Answer s : . * 
..  ' | Years of Experience -. ge ot 
7. “0 ‘ . : i NX: : ae 
. . : “4-3 . . ; 5 ; . C 
4-6 pu 3 _* : we : 7 i 
7-10 ° Boe ee 
oe 1+ . a 
: Wo Answer | 
~ : | a : 
Sorat Highest Degreee Obtained. 
came BA/BS : ‘ = 
oa MA/MS . : 
- No’ Answer ei : . 
Other Workshops ae “4 
' | Other ITCP Workshops *, 4 _ ‘oe 
ls they Human Relations Workshops = 
aes a : : : . ‘ 


Reasong for Attending the Workshop \- 
It satisfies a requirement or gives me credits I need _ 


pe Many others in my school were attending - 2 
F My superiors suggested I go ” 
My superiors gave me the opportunity to, go : 
‘Iwas selected to attend ; 
My attendance was paid for eo 
‘ I came because I really wanted to lear 
I'd heard... - . oo we 2 
I had a particular problem to solve - . 
: othet 
> ; 
54- ; ? : S 
é —\ ° . . ; ; ; : pe % 
oe 2 69. 
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. > 
- scales were selected from four instruments, the Student Activities 


Questionnaire (SAQ), (EiLLison, Callner . and Fox, 1973) 5 Student Behavior 


Description Questionnaire (SBDQ) , (croft, 1972) ; My Class. Inventory (MCT) , 


(1973). ° Hove Pee about the four. tésts is included din Appendix: on 


The Soke tests from which subscales were seletted were first 


Goriwidered’ in terms of the criteria listed above. As a second step, the > 


"evaluator Listed the selected subscale bens and summary descriptions of 


what the subscales were imtended to measure. A review of the list and 


o ee be we 


summary by several evaluators narrowed’ ‘thie ‘ve of dcales to ‘those 


which seemed most appropriate to ja ocee! ‘This. resulted in the 


selection of 17 eubecalens eae of the ‘scales is presented in 


Table 19. a 


- description of these subscales, along witt™the items ithenselves, — 


was ne ‘circulated to te developers éf the system. with a request for 


their comments about. any inappropriate subscales or any areas which eeemed 


to be missed. The developers were satisfied ‘that the’ subscales related 
td 


_ to the system and said they could add no other scales. for consideration. 


Because of the® large number of items involved, tug forms of the 7 
Asnate : inventory.were developed. Form A consisted of items from MCI 
‘and SAQ, while Form B was ‘comprised of the items from SAAS and SBDQ. 
Answer format varied for the different instruments: tad MCI and SBDQ 


have "Yés--No" answers while the SAAS a gh require suleiplé-chotie 


neercnees> In Form A, atl seems from t 


. 
items. In Form B, SBDQ items were followed ‘by SAAS items. Items from. ; 


are followed by: the SAQ 


each original instrument were randoaly pudered: Copies, of Form * ada 


70 .. foe 17 4 


Form B are included in Appendix kK. sa 


4 
of 
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(Anderson, 1973) ;' ‘and Student Attitude. aad Activity Survey (SAAS) , (Nelson, - 


Climate 


i Reinforcement of 
Self-Concept 


General School 
Sentimeht. . 
. a 


Process Approach. 


Individualized Approach 
(Decision Making) 


‘Teacher ‘Consideration 


‘Cohesiveness 


Friction 


Satisfaction 


Competitiveness 


Enjoyment of School 


* 
i) 


Reinforcesent of 
paleseyarene 


Classroom Participation 


ge i 
' } . ie 
- panociatte Classroos! 
Control 

oe 


Ld 


Nee ‘ * 


. Table 19 
Subscales for the Climate Inventories . 


Measures child’s feelings of- freedom in talkifg 


‘with school authorities and : following rules. 


Measures the: amount of . feedback ‘the teacher provides 
to make a child feel good about his/her work. 


Measures general feelings’ about school and” specific 
activities the child does which indicate feelings 
about school. — ue “ ’ 


Measures amount of class dtacussiogg which cause 
the child: to ‘think about - atcernere views of an . 
issue. 4 ¢ 


Measures the ameaint of input children have in. 
deciding on class activities. | 


Measures teacher behavior which is ‘characterized 

as: friendly and courteous to students. The teacher 
is considerate of student feelings and is easy to 
get along with, pleasant, and cheerful to the student. 


Measures the teather behaviors which motivate, 
instruct and obtdin student participation in 
academic activity. It describes the ability of 
teachers to appropriately structure class 
activities, encoura: students to express their 
opinions and allow the students to discuss and 
clarify their thinking about the subject matter. 


Measures teacher behaviors that are authoritarian, 
critical and impersonal. The dimension describes’ 
behaviors to dominate,’ restrict and allow little 
freedom for students to discuss class material. 


Measures the amount of intimacy students feel 
within their class. This would distinguish between 
children who feel like members of the class as 
opposed. to nonmembers. Cohesive classes sanction 
only goal-directed behavior.. : 


Measures the amount of q@arreling and tension, 
within the class. 


Measures‘the amount students enjoy. their class. 


. Measures student perceptions of the amount that 
students in the class compete with one another. ‘ 


Measures the student's enjoyaent of class activities 
and* ‘school work. 


Measures the amount of spaicive feedback received 
by students, either‘through personal contact or 
structured class activities. 


Measures student participation in class: activities-~ | 
frequency of class discussions, number of students 
who typically participate and SppORcuRlttes: for 
participation. 


Measures amount - of “student input into classroom 
decision making, planning of individual activities 
and enforcement of ruhes. 


' Measures the extent that students perceive their ‘ 


teachers as sensitive to: their own individual meeGS 
progress and goals. 


“Specific gas eeuctions were ‘created for the administration of the : 
questionnaires. The {natructions asked that each child write in the 


teacher's name and his or her grade: level. the children worked)a sample 
test ecg tick the eae sindaiektaboe'and then began work on their own. - 

: The test administrator was told to answer any questions daw otatants had - 
about taking tlie test. A copy of thé instructions fop-the test . 


¢ 


administrator is also included in Appendix K. In pretesting each class- 


ca 


‘room, Forts A and Form B were given alternately to students in the class- | 


0 > room. _ During ‘post testing, directions to test administrators suggested 
; : Ay a 
that students with reading problems might be given Form B, since it was xs 
e shorter than Form A. J | 
RESULTS a ee ee 
. r : : ce : : 


Analysis and covariance mae performed on the posttest scales of 
book forms of the climate oo the Lees score of the scale 
mo reine analyzed was used: as the covariate. | 
Mean. aaa adjusted mean scores “for the GPS. aaa the control "classrooms 


on sack of the 17 climate acales are presented in Table 20. , 


| Inspection of the differences bores adjusted mean scores for GPS 


a oes 
and control classrooms shows that the GPS classrooms were 1 more - favorably 
rated on nine of ‘the seventeen climate sales: _ The contect-glassrooms | 
were more favorably rated’ on seven scales and the classrooms from the 
two groups were equal on one climate scale. | | | 
The resulting F-ratios from the analysis. of covariance are presented 
in Table 21. | e, oe | 
‘No statistically significant differences Were observed between GPS 
and the control group classrooms. The data in Tables 20 and 21 seem. to 


suggest a slight trend toward more positive climate in GPS classrooms, 
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7” Pe - Table 20. ee . — 


/ ee ae eae. for Analysis of Covariance 


of Climate Postdata , ‘ 


a _ | Unadjusted Adjusted - 
Treatment Mean. ‘Mean 


My Class Iaventory (MCI) 


Satisfaction oF GPS . 
a , Pasko | 


-Friction® on - ; * oe 
: . Lontrol 


Competitiveness” ™*, GPS 
’ : Control -| 


any 
a“ 


Cohesiveness ~__ . = % GPS 
a : : _ Control 


Student Activities Questionnaire ($4Q) 


Enjoyment of School a rn : GPS. 

‘ ’ Control 
Reinforcement of Self-Concept. : : 
% Control. 


Classroom Participation : 7 , GPS” 
‘ ae F : Control 


Democratic Classroom Control _ ns ne 
: Control . 


_Andividualization of Instruction | ~—s GPS “4 
: _- . Control 
Student ‘Attitude. and Activity Survey (SAAS) 
PS 2 ay 
Climate e 
eet S? Control 
Reinforcement of Self-Concept GPS 
: sts - Control 


General School Sentiment | : GPS 
2 tee Control 


, Sao : : : cad 
Process Approach GPS 
é : . Control 


Individualized Approach ; . » GPS 
: Control 


Student Behavior Destription Questionnaire 
(SBDQ) 


Teacher Consideration . . GPS 
= Control 
* 


Teacher Thrust é cps* 
. a Control 


Domination GPS 
. Control 


ome ans *These scales i eal negative auetien® so ‘that a low score indicates’ a favorable 
i 58 rating. © s mae 4 
7 , ; : / : ” 3 ; rae 


"20. 


-y- 
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4 “Analysis of pea 
(. chinate® ‘Ques tionnat p Post, 


’ My Class Inventory (MCI) ae 


ve Satisfactign 


Friction 

¥ e L 
ares 

Competitiveness 


 Tréatment._ 
Error 


Treatment ” | 
Error 


Cohesiveness _ 


; N : 
Student Activities Questionnaire (SAQ) 


# Enjoyment of School . 


Treatment 
Error 


‘| Treatment — 


Reinforcement of Self-Concept 
; Error 


Treatment 


Classroom Participation 
: Error 


Treatment 
Error . 


Democratic Classroom Control 


Treatment 
Error — 


‘Individualization of Instruction. 


“Student Attitude and Activity Survey (SAAS 


a 
4 


Treatment 
Error 


Climate 


Treatment 
-Error 


Reinforcement of Self-Concept 


° 


Treatment - 
Error 


General School Sentiment 


‘| Treatment 
Error 


Process Approach 


Treatment 
Error 


Individualized Approach 


¢ 


Student: Behavior Deseripeion: Questionnaire 
ee 


Treatment 
- ErroP 


Teacher Consideration 


Treatment 
Error 


Teacher Thrust 


Treatment 
|: Error 


Domiizyge ion 


- but these differences are small and statistically insignificant. 


Ls 


These 
.data may teflect a lack of training effects. Howeyer, several problems 


withthe atudy, itself ney gee have contributed to the lack of effect. 


_ The suall number of teachers with usable Sieaee date. selection bias, 


ta effect on teacher babsttor, if in fact it is Presents ci 


the higher: than fourth grade reading level of several scales decreased 


_ the possibility of finding. significant differenced. ‘A short: ‘time’ period 
‘ “ 
between ‘aarcaad and posttesting may have prevented observation of. a. 


Y Cr rr 


In summary, while the ‘lack of evidence may reflect a lack of 


training effect on climate, it may also result from several difficulties 


in the gtudy. ‘Until more carefully controlled studies have been ae a 
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it is. Ampgssibie to , determine what effect, ‘4f any, training in GPS might 


have on classroom. climate,. 
: aN : : = 
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CHAPTER FIVE 


a 


SUMMARY AND DISCUSSION 


In this final chapter, the ‘methods of ‘the PETC=@I evaluation are 7 
briefly reviewed and results of cheese evaluation studies : are summarized 


and discussed. 
‘ A 


REVIEW OF EVALUATION ACTIVITIES 


* 


‘this evaluation submitted the PETC-I instructivtial system to a aeviee: 


ae 
° 


‘of tests where information was collected to. determine? . 
. va 
ya 

1. The effects ‘of the Jaatedct iad: ‘dysten: on 

‘(a) skills trainer Stee a ‘(b) “their 


perceptions of the relevance, utility and 


.' need of the training pak ee . 
' . £ outcomes Meow, en. be oo eS 
42s, The importance of PETC-I seereacteltes and 7 — 


w 


aifferent conditiops of training for meeting 
satisfactipn and knowledge outcomes 


San 
. °°. 3 The effects of akills trainers with different 
“a, . >? prerequisites and conditions of training in , on & & 
. producing outcomes of satisfaction and- 
." - knowledge in GPS trainees. 


7 The impact of. GPS training on clasaroou: « 
climates of teachers who have completed 
GPS workshops 
’ Three niagi erienee studies were conducted to examine the major « 
aeeies cited. above. ‘The first study compared satisfaction ang. knowledge 
outcomes of three groups of skills trainers. ‘Subjects webe recruited and 
asetoned at random, when possible, to three different treatment conditions. 
| Subjects in Group A had completed at least one of the forementioned 
_ prerequisites but received only a one-day abnceviscad Graaenent tatended He 
to familiarize them with, but Aces train them in, the PETCal system. , 
erage B co consteved of subjects who had nok. taken any of the PETC-I . = 
a 27 16. \ ae 61 
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oo 


Sterequisites but tin recgsted the full PETC-T workshop. ‘Group Cs the - 


45, respectively. 


is assigned from a pool who signed up a the wo one 


“ ¥. 2 


i. 


fuk treatment~group,- ‘consisted of ‘subjects. ho: had - taken. at’ Least’ one ’ 


“5 * 


} 


‘Of the PETC-I prerequisites—-Interpersonat Communications or /RUPS and 


° 


” received the full week of PETC-I training. 


Study: 2 provided a comparison of the effectiveness. of Group-A, ‘B and 


Cc skills trainers in producing gutcomes of satisfaction and knowledge in - 


GPS trainees’. Recruitment at. ‘two test : ‘sites produced 170° GPS apeaen Ips 
These Prsctpents were randomly aseiined to trios of epatiers: Se the . = Ss 


three groups: described in Study tine The number of GPS participants 


receiving training from Group A, 3 meee skills trainers were 65, ‘60 and 


Instryments to measure the wgeben and trainer effectiveness for. 


_ 


of - 


Studies 1 and 2 dricluded a questiBnnaire: to measure ; participant satisfacz, 


“eto, and perception of utility, relevance and need and a test -to measure 


Knowledge cs aaa Posttest only. designs were used in both studies to. 


eliminate test reactivity. . a : 2. ar 


The third study investigated he iapake of es training ‘on the 
{ 
clitiates of ChusEroane tae by: teachers participating in GPS seuistions: 


The ‘study compared two groups of teachers-—teachers era ined in, GPS and 


‘teachers receiving an abpreviated treatment. Subjects were pagdouiy 


jasstoom climate a 


groups or to and ! following the raining. 


AAs . 
«6 eg ae @ : : ‘s 


ss ar ; 
oe OF RESULTS AND’ DISCUSSION “i 


se # + 


On. a nuebes of fous intended to measure pattetectton, 


perceptions of relevance, utility. and need, skills trainers in a 1 


responded very positively. toward PETC-1, and. che gretning experience. 


62 ee .-* 


ao 


Averaging the reaponses in the two. most: positive resporise , cateporice, | 
. 


these. @imensions, showed over ‘85 percent narking high satisfaction, _ 


- treatment group) producing. ‘higher. results. than Groups A. wal Be in most, 


' . the results indicated no. consistent or meaningful pattern of differences 


¥ 
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the need _and parential offered by PETC-I. 


80 petcent high relevance, 70 percent ‘much ‘utdlity’ “agg. 


"When the responses of subjects isi the three treatment. groups were 


compared, ‘a “slight trend was identified that. shawed Group Cc (the full ; 


84 percent secing™ 


instarices, however, Shiese. differences were slight ‘md their importance unknowh. | 


As in‘any evaluation study of any training system, responses of 
; 


participants regarding their impressions of the system are a eriterion . 
of varying, utility. If one is willing to accepel gvorabe responses _ 


from Participants coflerning their experience as being a aufficient good 


» 


‘to justify: the system, then further evaludbion: may not be necessary. oe 


the other hand, ‘an enjoyable and seemingly relevant. as well as useful 
eeoeetence may not. be sufficient justification for some people.” | 


-On a: ae developed Knowledge Test, porticipants produced a 


e 


mean score of 31. 3 out of a possible 48 over both sites end the three 


groups. One-way analysis of variance between means for. the three erqype 


. showed no significant differences among. the conditions. In other words, 


among groups, with aiffering ‘amounts of is ace and training, in~ 


“Tnosrecse acqyired. 


age 
1 ee 


_ There are at least two osneibie explanations for this finding. First, , 


it ie possiple that prior knowledge of concepts taught in PETC-I or the 


fact that the treatments aré equally weak resulted in no differences 


‘The ‘authors are indebted to ‘Robert L. Ellison for raising the issue in 
this paragraph and recognize that it is only one of many value dilemmas 
which cannot be easily resolved regarding the value of human relations 

or group Process skills ‘Exaining: ; 
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be between ‘subjects. Since pretests were not given to avoid reactivity, it 
‘is impossible to 9 a of differences in knowledge gains for those who © 
came to the craining with varying, amounts: of prior knowledge. _ | 
. Sacond Ae is possible that the measuring instruments were: deficient.. 
2 Perhaps the items nednaved other content such as test-taking skills that 
are not associated with prerequisites « of freatment differences. Perhaps 


2 the items’ were not sensitive to the amount of PEeaencat | or : aid not 


oo oe egg ese. 


sufficiently ' ‘cover" is content taught or learned. 

. In ae 2, GPS participants’ esponses to items intended to 
measure - satisfaction and perceptions of BBPGvanGe: utility and need also 
resulted in a very favorable buacecne toward GPS training. The average 
“percent marking the a two cavepordas: for item etusvexs showed over. 
oY percent Teporting high satisfaction, over 65 percent reporting high 
relevance and utility and over 93 percent responding positively, ‘to the ” 
“need ‘for and the potential of GPS training. | | 

a When the responses for subjects assigned to the three groups were 


° analyzed, the results showed those in Group B evidencing significantly 


less favorable responses than those in Group C.. Essentially, no 


—" 


. differences existed between responses in Groups A and B oS those 
. in Groups A and C. This findi would suggest that the full cvuntaant! 
produces the oak favorable responses but, given a choice, a one-day _ 
briefing of would-be GPS trainers who have completed one or more 
similar instructional systems ta the past would have higher’ pay off 
than a week of PETC-I ereiaing far would-be trainers who had not had 
ccpeviences’ in, Aimilar 4 instructional is daa Again, one must ook if 
favorable reactions by participants is of sufficient good to justify 


8 ‘ ‘ GPS eratatas apart from the question se siher woul’ provide that training. 
i. ; 


64 +» 


Qo: 
ERIC 


e@ 
ERIC 


GPS trainers are ‘equally tnportant or)unimportant. 


in classrooms ee by teachers who had not, been. trained. In. — 


an even broader range of evaluation strategies might be considered. te 


4. 


croup Proceas skille parti cipanté dicrose sites and groups ‘produced 


* 


. am average mean score on the Knowledge tse « of 10. 3 out of a possible 15. 


One-way aciahyate of variance between. the means for: the three groups i 


s showed 1 no significant differences among groups. As with ‘the Knowledge are » thy 


‘Test for PETC-I, it is ‘Atmposeibie to. determine what mix of. priot knowledge. 


'g 
weakness oF treatment or inadequacies of: measutement instruments are se 


"responsible for the findings of relatively een Howevess* for 


a study that focused on PE: ~I, the. finding of no differences aniing GPS -" 


trainee’ ‘groups suggests that amount of prerequisites and training for — “os 


ie ow 


‘The major finding in study 3 was that" ‘students in classes taught by” 


GPS trainees did not Feport any more positive classroom €limate than those . 


C 


verify er ‘disprove this and the findings of Studies 1 and Ze ae 


“followup interviews and. observations to. Soidace: 


Be 


Strategies might. include 


““eritical incidents” epncabaiad use of knowledge and skills gaisied in 


PETC-I; the examination of other treatments in addition to training in 


the total systen and the one-day briefing to determine features’ oe ; 


produce more or less marked" treatment effects, anid monitors (senior trainers) . 


me) PETC-T to observe climates: in craseroons of PETC-I eeainess for. differences 


t at might be compared to ts edeucts of prerequisites and PETC-I training. 


_ 
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. 2 s : eo ~ : ee 5, a . 
“The management plan for _the- Improving Teaching, Competencies propia” a 


Altea Resnzice Allocation and Management Plane,. 1974) ‘divides the work 
_— ae rear: 
- flow” “for the development of an sastructional system into. five phates: 


* siannidg: pilot, interim, field’ test and outcome. Each _Phase gonsists. 


% of certain development’, evaluatgon ata: fel reiations activities aoe " 
7 : 2 ve Pe 
that, culminate in a milestop “Feport. ok a gee Fs 


ssociated with developing « an. “anberuceghal 


The Fange of activities 


system is ‘summarized in Diagram I. “These activities are divided: dato: ~, 
— 
“five major ‘eategories::, needs, obfectives’: product development; testing 
ARS . '% 
: ‘and “AmpleneAgation. Diagram I ane /partitions these. activities. ‘among, 


">. ‘ 
seven: fuct foal, areas ineluding nanagenent, Biptormen, field ‘elations;* 
¥ 


_dissengpation, formative evaluation, dntérnal jsunmative evaluation and 
va . e oa jj *. 0 


external, summative evaluation. The’ matrix. is. not necessarily: es age 


o 


preset ceiptive nor are thie ‘exaluation ‘relationships among tach part”. a " 

: cd ag - «@ 

stric ly’ Linear, ee. kes, hte ~~ Sue nae ; : oe 4 
. The specific activities ensaed th ‘quvitis the development of. an, 


wit ar: ) 


“insttuctional system differ agcording’ to chy: phase under: considerations: ae : 
“the sete teed of the specific ‘product or: change ‘support’ process being iy Tr. 
‘ r oo 
developed and > ecasionalaty due- to ) style pheferences among, work: unit 


eames. For more specific and erst e atenents, reference should be 


2 
° 


“made: to ithe development and evaluation Pipa, and documents’ for each, 


> 


a aad 


a . : .. A t,o _ : 
work unit. fae , sas _ “ 4 


- Evaluation ‘differs according to each phase of ‘the development. 


ca 


Dieting the’ initial’ phases, evaluation focuses. on folie issues arid . = — 


i a. 


_prowtegintoration primarily: for | ‘system developets. "During the. latter 


* 
. 


phases the- emphasis “ts -on> summative —— which provides. information 
4 we ‘a ‘ 


eee ; she a ; : 3 so, \-. ; 
ee ae a Z ; - 7 : ee _ fa 4s : 
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CHING COMPETENCIES PROGRAN 


——~tralution— a i 


Thaoretical/Nalue’ — | Approves a docunanted cou rablondle j ranges. for any externa} rvluates the see 
“ taylrical | feed statenent ag; =]. atahh atbument with regard i Np: nasd statement, 
: | the lide | to dissemination, ee. ; 
‘4 Plald Deslre/Resdiness | <1. fhagatible vith | r © |. Collbwiat pevcndares for, | activitdes, Bae 
; . ogres and value - : " coblen, i, Meant og mvoole | ' “ factors 43 an in Nedtion } 
i) Rupert Review . positon a populatioaa archngiag:  Datianalnen ddananiation of the nunbir of people - ‘ : 
one a ‘cluoitbecsie “LT for dita coldéctlin, troy * plefornance requirements | affected, the soclal 
: "9h feantble priority * eee. identit Lad : areal ‘| and constraints, significance of tha need, |. rf : ; 
: for the Progran to | pwlev, Literature review | colleotlog the Haty ‘ae? the absence, of : & 
' undertake. of rm 9 ee Wall. os delivering abe “Parlorns alneion analyts, wubstituten, the veqency sel . “4 
: to ‘ es i sin praca unctional analysis, of the matter, the “sl : 
. ; aon ei “TIA taken raageamedat of aaron ord vs [- tank analysis and poulbility of sea .. 
and approprlatangss of! ra. fo pathod/means analysis pultiphicsty attects.. yo 
iS approschéa to data “| “fot dinsemination of Need atatwunte may & or 
‘ gathering determing Sof th foxs product, * derived from such W9 7 - ‘ 
; sary fem Field of , : ‘| aly ' md : an the learner, thes 7 
gem a be oT aad tural sookaty of the subj . t 
ta, sortie i a |e : . | setter. { : P 
: : Gaterna) cumative | 
| : é suaient of needs, 
Tt Ea be Npprove any a il ' a 
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—— Ddagran I | | . a 
“>. PRODUCT DEVELOPHENT Ii) IMPROVING: 
"TEACHING COMPETENCIES PROGRAM: 


—— sm a : ror papa et 


oatcrives a 
Purpose Netaven itatenanta of 
instructional. ayeten'n 
realy Outcase purpose and behavloral 
* Objectives ."pobjectives a ach stage 


_ 4 | aie Planing, product 
Oehavicral Testruneatal’( Gitelopment and - 
Objectives ‘wraluatlon an iterated, 

. | Thane etatemdats are 
Wong -conaldered in relation to 
; thelr appropriateness to 
Program purpose, values 
“and Coankbility within 
. Progeim repources, 


| Approves approprdatendss 
“} of aupart reviewers and 
{ teview procedures, except’ 
| tor extarna) tamative 
reviews, ‘ 


Column headings should be read as funct fons” 
{rot roles or person). Heedings in Colum] 
[denote five major classes of activities, ha 
* [particular sequence dr temporal relationship 


be.read as prescriptive tor any particular 
work unit, Agein, nd particular sequence oF 
teaporal relationship is necessertly {aptied, 


_ ['s necessarily faplted. Entetes shoutd not 


Generates general goal 


wd refines objectives 
of Instructional: system; 
to be completed by 
iterative permease, 


Collaborates ‘and concurs . 


vidi oe to 
oper lise and 
cladtly objectives, 


_ | Mevinas statements of * 
objectives when ; 
appropslate on the'basia 
Of tentlng and Inputs 
tron Flald refations 
af formative and 
suimnatlve qvaluation, - 


Reviews product 
objectives, ; 
Provides feedback to 
developers and : 
evaluators concerning 


potential target groupe 


for whom the objectives 
ara calevant. 


rT 


Gongrates dissemination 
objectives in ~ 
collaboration with 
developers and evaluatora. 


’ 


slides the 


oparattonalitation of, 


"| product objectiven for . 


maagutesent purposes. 


| (Deterkinen' relevant 


donaing of variables from 


} object ven.) 


Clanaities objectives 


“] dato categories as 


approptlata. One possible 
cateyori pation scheme - 
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1, Instructional 
objectives (trainee 
behavior) 
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objectives (teninee’s 
behavior} 


», outeome objectives 


oY indicators 


(trainee objectlvasi7] - - = 


" "4. Iopact objectives 
or indicators 
(evidence that 
changes in trainee 

*. bghavlor wade any 

i differences, fn a 
secondary target . 
group) ; 


5. Implementation =» 
objectives (trainer 
behavior) 


Other Factors to be 
considered are the 
prerequisite competencies 
or experlences of the 
learner and social and 
psychological 
characteristics of the 
leatner.* 


, boordng keys, mmpitical J re 
| base for constructs, ‘ » of 
‘taped. ' ey 


tneasal femtive — 


‘Evaluation  preluation 


Attanges for any external Ivaluates the a hate, 
summative evaluation of : 
the objectives, 
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 Tantervetional'syacen | Aearations of content, 
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Colum headings should be read as functions 
(not roles or person), Headings in rag 1 
denote five major classes of activities. No 
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1s necessarily faplied, Entries should not 
ba read as prescriptive for any particular 
work unit, Again, no-particular sequence'or'|; 
4) relationship {5 necessarily, Jap] ied 
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of content, materials, 
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participant 


Initiates and arranges 
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-Teachable market 
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> tf wabddley of Halk 
: , test reports and 
. | critiques approprlatences 
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The following paragraphs describe in. general” terms the ways develop- 

- ment” Mand evaluation activities are ‘organized for. each Shae of. preance 


development. 4s 
: A , 
‘Planning Phase. ‘thn this. ieee, several. ey ecpivities provide the: 
Wee: 7 y ae 


‘Foes ‘for effort. The ‘initial | conception of the proposed instrdetional 
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ee oe ae 
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iPa ry 


cotipleted. By. the. “end of this 5 phase, the, dpproprlateness, % objectives ¥ 


has been determined, statements of, objectives finalized and instrumentation 
"to measure these ‘selected or developed. For instructional systems bud i, 
: oe it : 

: requiring a workshop: format sagedtcations are’ determined for desirable 


—_workshop_conditiéns and qualificagzons for effective: ttainers. * . ; ie 
roe _ The major focus of the sedis. activities for ‘wis Rhase is on” 


Ss 
fia Bee oS 


: 4 
‘confirmation ofsthe system’ s abtnity to produce’ sepegifiea short-term” 
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Appendix B:_ . 6 
: CRITERIA FOR PETC-I SKILLS TRAINERS 
— AND SENIOR TRAINERS” -C 
i 
ee . - y Pd 7 
1 ve % ; 
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. CRITERIA FOR PEDC-I. SKILLS. TRAINERS 


By the’ competion af ‘the! two: week PETC-1 system, ,the skills —_— WiLL 


_meet’ the following criteria: atl ; 
“a ; - bs J a a c 
1. Have, and use valid ratjonale(s) for maintaining the. design of 
os. the PETC-I system. ./ . , e 


: . 4 
2. «Have and use valid rationale(s) for selecting, sequencing and 
fos "modifying skills pratnine ‘exercises epprorr4are for the need 
‘ . of the GPS groups’. 


\ 
3: Be capable of being constructively responsive when cegnfronted. 


4. Be able .to weate group’ con i fons that are supportive of giving © 
-and ae eee feedback. 7 
: : AY 
“25. Be, able to reqpgnize and apply intérpersonal influence skills as’ 
‘well as to allow self to be influenced.when BPpECPErTe: 


€3 


Ry 


6. Know ‘and apply*basic skills ‘Gearaad in the peabeuntates 

' me ‘Utilt2ing Problem Solving: (RUPS). training. 
2 5 * . v° aa 
7. Know and apply basic skilla ‘learned. in ‘the ecu eal 
fo. Si aed laa Cormunicat tons (IPC) training. . 


skills araining Workshdp prior to conducting a GPS workshop. 
‘3 
9. Have skill .in assuning*and using each of the five roles of* 


a trainer: : . 
: : a an, 


CRITERIA FOR PETC-I SENIOR TRAINERS 
. ; at ‘ 
“fhe perc Benier trainers will meet the following, criteria: 


8, Havéchad the ee of being a participant in a PETC-I 


1" Have a use valtd:rationale(s) for maintaining the desigrof 
the PETC-I system. 2 


S 2 te capable of being constructively, responsive when confronted. 


“3. Be able to create group , conditions that are supportive of" On 
i giving and receiving constructive feedback. ) 
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_ 42. Be able to recognize and “opis intérpersonal infliience ‘skills |. 
agi well as to allow self to be influence hen appropetave: ° 


5. Have. skill ig, assuming arid ‘using éach of the five roles of a: 
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; u a : f 
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‘Know and er the skills presented in the neseee! Utilizing ‘ 


_, Probtem SOLUENG ¢RUPS) : training. « ; 


Know ,and Supily the , skits preserited in the qitesperiondl 
Communications ( 4PC) ‘training : Az 


Have a participant oriented ‘experience before attempting to 
conduct a PETC-I workshop. . At : 

, XY fie wv ¢ : ey 
Understand the relationship(s) Q: structured process training 
designs and priorities to BESErUrE ed ia training designs. 
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Be able to differentiate between clien) 
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ede and, self needs. 
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Appendix C: 


BACKGROUND’ QUESTIONNAIRE 
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PT | — BACKGROUND QUESTIONNAIRE . 


- : ' PETC-I and GPS Workshops 


4 


1. Trainee Identification Number: |e Me ae i 
| 3 


: Please do not 
Y : ; write in this 


2. Name: ; a . margin 
3:. . Home Mailing Address: Street Phone ° 
ot City: State Zip ~ 
4. Work Address: Street i Phone 
: City: State’ ay ‘ ' Zip . 4 
ar (hie qntormsticn needed for gathering follow-up aan x a 
5. Ager”. a ‘6: Sex: F , we te wy . 
7. Position: ) Teacher - (1) Primary, 1-3 
. oS . ; (2) Administrator (2): Elementary, 4-6 
"(3)" Staff (3) Jr. High, 7-9 
: $+ c 3 — 
: /\ ‘ (4) .Sr.. High, 10-12 
8. Highest Degree ‘Obrainad: . : “3 4 
> (1)* BS/BA___———s« (22)—s« MS/MA _ (3) Ed. D./Ph.D. 
“OL Years Rxperience: eon 7 . ar r 
5 a -. : . 
Teaching : . Administration 
Staff Work i 
z | sad ; —- . . . 
10. AUREL Tabtewettonat Systane Pravicusly:. Attended: 
(1)_ Systematic & Objective (\)___Interpersonal __- “h, 
‘Analysis of Instruction we [communica tfdmet PC) * 
‘ ; _— 
(1) Interaction Analysis Yt wT) Research Utilizing . _ 
°(1)___ Facilitating Inquiry “\problem Solving (RUPS) > 
: ae ” & ; > 
(1s _Higher Level Thinking : (1) ‘oup Process Skil1s(GPS: 
‘ (1)_ System Approach. for ec Mt Ot ‘- 
' " Education(SAFE)) = (1)___PETC II 
(1) Conflict-Negotiations 4 “/PETC III : 
"U1) ___Interpersonal Inf luence(INFY : 
ll. . In “addition to the systems listed in Qu¢stion 10, please indicat ‘ 
(1) + below all other training experiences you have- ‘participated in ve 
* yelated to group and interpersonal dynamics, and probléfn solving . : 
Please ess whether you participated'.as a student or trainer,|~* ~ _ 
when the traifiing took place,+and what, the general nature of - ‘the | oN 
Le traifing was. (Include courses, workshops, on-the-job trainitig, | « go eS 
etc.) : 101 ; )f ie as 22 
fe a “4 3 : 1 * . +: 
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, ‘Background ‘Questionnaire : | S- ae 8 : 
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FINAL QUESTIONNAIRE 
Z : . 


‘PETC-I Skills Trainers 


Trainee's Name . a oe or : 2 

. = 5 : on a 
. ; - 4 ‘ | [-| | | | : \ : : Please do not 
Trainee Identification’ Number =. write in this 


gay ° ; : 1 2,23 4 5 6 "> margin 
Trainer's Names CO—C SYS a . 


S:*_ For most of ‘the questions that. follow, 
He od pléasé. give us your: honest appraisals. }- 
: by making a mark "X" in the space that]. 
a best, represents, your opinion. 


‘A. ‘To‘what extent has this. workshop fulfilled | your expectat: ns about what . ° 
you personally might ‘get: out of it? ~ os : 
a ‘Has not come , . _ «8 re sas oe ee : 
pea. ALS fd ffs BS 3 
‘ SS SS a a en ay, p mmpereee rene 
expectations ts 32 ae es 5 6 . 


, ip 


_ ee What exactly has happened that brings you to this ‘conclusion? . 
© : - o ® 


é 
. 7 : rs : : 2 
‘Be Think for a moment about thé informational materials, practice exer- 
cisés and methods used in this workshop. All in.all, how would yoy o 28 
rate them? (CHECK ONE BOX IN: EACH LINE) ft yt : 
i “ a ‘ e : ct : 
3. Only restated’ or =< Offered new. insights, h 


e- 


proved what I ‘ : 
A o 3 a . new ways of viewing . 
ree a ra ee / 5 / 5 / ; / ; / 7 / old problema" . . 
7 ‘ ‘ . . . a : . . 
‘4. .Spoke to - _ Missed the important | - 
: ' dmportant . = issues, vital concerns 
i issues, vital /  / / _/'/  / /'' J¢% 
: : ae ee. 
5. “as s qf Clear,’ concise, 
; / a / / ey / / / . understandable f° 
: T.2 (3 4 5 6 | 
A . 4 . 
‘6. Ideas, ‘skills’ a4 a ; ' ° Usage would require 
- Methods can be / /_/./ _/__/ changes in conditions . 
_” used immediately - gl 3 “4 3 2.T that I have no control |" 
. °. under existing tom ; over “ eo i. 
Bo conditions _ ’ + ae Spe ; fe 
‘ . : . ; - : = : ne 
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7. Little "how to™ °°. oe . i. 
help for my © - (. / 2 / // _/ Provided :real 
* actual group | eS sb. 2 3 4 ,5 + 6 “how to" hélp 
work ts : Me 2 . for my actual 
, ey =. * " group work 
8.’ Material ~ Pe eee _ 
‘maintained _ wos I Material failed 
my. intetést : 6 5 4 3 2° 1 to interest me —~ 
9.” pefided much ee ae on, — Soe 25. 
a inal Js /  /CDeémanded ‘no; 
he ceaae a 6 5 4&4 '3 2 1 original ,thinking 
{o. Braceiee 7 - oe aa ies ~ 
exercises were. « / / -/__/__/ _./_,/, Practice exercises. 
of little or -il 2 #3 4°56 — were of great valu 
no value. .- ; e a Wot 
- aay : * : * 
_, lls Sessiéy time / ‘ ‘ : Time in the 
"was well used’ “ff I sessions was : 
- 6 5 % .3.2 1 ~ wasted 
go v bee “Structure use- oe ‘% a 
ful, promoted’ © / _/. /_ / / _—/__/ Too structured, 


(: learning - 2 6 5. 4 3 2 1 ~“ blocked learning. 


13. Ga ined new 


‘insights oe 1 ¢ CO Af ueila sone 


my style ‘of : “6 > 4 “3 = ie new about my style 
. consulting ft *, of. consulting 
14. Allowed time -_* ‘Did not allow time 
Cab ar Ae / I I for reflection 
_ A out self and =- 6 5. ~° 3 2° 1 about self and. 
ve -personal growth ee ee ; personal growth 
2 -_ % 


, aor Considerin; this dorkshop as a eretaiae program for colleges and : ; 
* school ame (CHECK ONE _SPACE FOR - “EACH QUESELO) . 


15. How. would you rate ft in terns of fits parent tay for school 
i provement? - ; 


~ Low potential ii zl Ae, ee” A SE ee / “nigh cee al 
ee : ‘< Fe l 2 3 : 5 6 . 
by How: would. you ‘rate this workshop: compayed to -“~ethet professional = 
Centar? COUERES you have : 
: paken? 2 


 verytow °  , L_ fd Very high 
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D.,',Condicting the GPS Skills Training 


1?. In an overall assessment of your training experience, was its, 
: . ‘ : . \ “ 
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Extremely ° 
yar valuable, . , 8 = 
worthwitile. ms /+*/ _/ __/ / / 1 'rtle value, no learning | » 
experience, - 6/5 4 3 2 1 plished 
- Much learning . ; fi 
actomplished. S i : rm) : 
ff + 
What are the major factors contribuctng to yeur assessment? 
Powe ee 
18. What were the speacie c ‘Learning for you as a result oS your 
oe _ training experience? oe . ‘ . 
“y ( Af 7 ; i , : 
* | ‘4 ao 
19. Problems arise in almost every training. mADAETOUCes What sort. 
a of problems, if any; did you engineers: a 6 ae 
Si : _ Bs; % ¢ 
t 
t a” 
E. “tn all honesty, ‘how much do you plan to use the ideas, skills and/or 
, materials presented: in chis workshop as an integral part of your work? a4 
Yo o¢ ; , SF aaa Syl. 
20. - Extensively ae , Not .at all — oa ane 
| [Se ST SS ee a ‘ 
6 5 Doe Sane a e 
21. How do you think this eee ar Per will be of value to you 
in. the future? . ° 
m2 
> ¢ 
# Se . ; 
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F. Now that. the workshop/course is over, how would you sum up the: 
experience? ; 7 
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22. Not very a - Extremely 
: worthwhilé io a ae ae oe ee worthwhile 


ee ee ee 


: ' og 
23. What are the major factors contributing to your assessment? | 


yo? 


By a 
Ss 
24. Which of the followin costs did you incur out of your own pocket 
_in order to attend ce workshop? AEs, please estimate the : 
< amount. . * 
- $ . Travel costs . a 
; oO toy : i ; 
$ ’ Room and board a . * ) 
. 7 Tuition or fees ( 


"  $ “ty her expenses (what?) 
ae 4. ® : 
25.. Did you give up potential income in order: to attend ce. ges 
“other jobs?) — : 
af 


(1) No ; a . > 14 8 


1 


(2) Yes. If yes, please give an estimate of how much $ 

; . wo 
26. Considering the costs (e.g., monetary, roen "ete, ) that you 
incurred in order to abrene this workshop, how do you feel?’ 


(2). The costs were about right. for what I got out of it. 

poe e343) The costs were small compared to what I got out of it... 
Additional Comments: , | ” — , 
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(1). The costs were too great compared to what I got_out of it. 
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Please donot ° 
write in this 
G. Please circle the response that best rébiecis your opinion of the -mdirgin ; 


Following characterjstics of the works lop. \ % 
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27. PléaM@drate the goals and objedtivas for: 


5 
: . a. larity * 
; Barely 
. . Excellent Good Satisfactory Adequate . Unsatisfactory 
5 4 3 2 1 
. As oY fae ° : ; 
by Signif icance/Impor tance ie 
Mm S ; 
, Barely 4. . 
Excellent Good Satisfactory . Adequate Unsatisfactory 
5 \ 4: 3 ‘ 2 1 
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' 28. 'Please rate the workshop content: Skills, concepts, principles, 
and values for: roy 


‘ oe ‘\ : . ; 
a.’ Appropriateness for your expérience and understanding 


? 


: ‘ Barely | : 
. ’ Excellent Good Satisfactory Adequate Unsatisfactory 


G& . "hee 8. c 2. er 


4 +b. Relevance for learning to be a skills trainer 


; Barely 
Excellent Good Satisfactory .Adequate Unsatisfactory 
% tae OO an 4 3 , 2 , . 
. e ie Clarity of presentation and definition «— ' 4 
‘ F Barely = : 
Excellent Good Satisfactory . Adequate ‘Unsatisfactory, 
5 * és 4 _ 3 2 os 1 


d. Parsimony (little or.no unimportant or not useful material) 


Barely 


Excellent Good Satisfactory Adequate Unsatisfactory Ree : 
a 4 a 2 . i 


fo 
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e. Practical significance for successful skills training ’ 


i: . Barely — * 
a" Excellent. Good Satisfactory Adequate Silk aaa 7 
wee . a» . : 7 
a a a: ae 3 * 2 7 4 1 he m _ 
. * . . ; \ee = Pe oe = 


ga ee ae WS a 


e ™ ? : fe ae 2 Bares ck 
| oa a “ 
‘Final Questionnaire, - gt 


a? < 4 4 ee b. te 


29. - Please rate’ the workshop me hods/strategtes/pro 
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Adequate’ Unsatisfactory ~ 


“3 ye es ce ‘ al ; j , aeaa e 5 a ae 
- 7”. . b. “Practical usefulness in learning training ‘skilis- 
Ss Sk oe a ana > ao en | 
ath a a Barely - | r 
a 7 Excellént Good Satisfactory. Adequate | Unsatisfactory 
et Se, See 
Ty, % : ; y . ~ “hn 
7 ‘so. Efficient use of time f 
a aa : “ Barely 
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Fina estionnaire © . a 
~= ' “ : = : i ee : * : , ———————— 
im Pe kg eae : ' ee we of ‘Please do not 
. rd . : I : * s write in- ‘ehie . 
31. Will you ‘teed ‘the e opportune to actually ao as ites a 
training again? ; : - “ 


ry . . 
w A . a . ¥ 7 " “a 
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| 
Peal) xés : ; he e 4 oe 
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ee rae : — - ; . . 


“ corn (2)___d _No Gi a he s , . 


t 
32. Do you Hae time commitments and pre-requisites for PETC-I | 
are excessive? . i | ; 
Co 5 ; “* 
! 
i 
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(1) Yes, sccaerety: could be reduced somewhat 


“(2) No, they are demanding but necessary 
(3)_-_ No strong opinion either way 


33. Do you believe. there is a need in the educational community for: 
: a with group Process training abilities? ‘oe = 
-@HECK ONE: (5) Definitely strong need 

(4) ; Probably some need eS : * , » 
(3) Probably not much need _ a ~ 
(2) Definitely no need : | 
(1) ‘No opinion . , ° 

L * 
34. Please rate the potential of PETC-I for. meeting such a need: 
CIRCLE ONE: Excellent Good ‘Fair Poor None 
§ ow 3 2 1 
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* 35, Would you Pasenneed this workshop to a friend whose interests ° 
are like yours?. 


‘Yes, recommend / ee see See Ae = Denies 
highly . 3 5 4 3 ad 
‘ : : ‘recommend 
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_ PETC-I KNOWLEDGE TEST 
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a 3 Soe ee _ wee a a ; 
- ail eo oe an \ 
= : © * i NC ; : i he = 


; , a 
; £ eg , : 
Site 7 a Pleasewdo- not 
7 er ; : ; 5 write in this. 
cl a _- enue As 
5 6 | : 
: “7 “~ 
‘Trainer_@* «Date ‘ 2 
* ~ . j Cc Pe cs F 
: f . : = a = é st \ s 
‘ 7 , r > . ° . ‘i : . » x 
= & oe. es e . % 
iverickiods . . : " 
—— . - o . 


We hi havé | designed this’ fest to 0 help (ap assess to what degree parti- 
cipants have learned the major ideas and skills: presented i ‘he 
‘PEIC-1 Instructional! System. It ig intended to evaluate the * « 
system, NOT YOU. Your Tesponses to this test will be _Somplerel yy 
confidential. 7 o 


# 


e i 
. 


Each question has a geoue of responses from which to choose a ° 
answer.’ Please indicate the response which you think best answers 
tthe question by either cit¢ling the- number pots the response(as 
in’ Questions1-5) or marking the number for the ®qrrect response’ 

in the space provided next to.the question (as in Questions 6-12). 


e . . . 
- 7 = o. . SAY 
cc @ ar mos : 


yo : ; ° 


: lL. The skills trainer's purpose in relation to a GPS group is: 
* (Choose one) 


l. To gain diverse group experiences and sharpen ~ 
trainer skills. . 


; . 2. To kglp the group grow. in its ability to work 
LI! effectively arid productively. 


_A. To provide feasible solutions to ‘the immediate 
problem of the group. 


4. To guidé the group through the GPS System. 
2. The purpose of developing a & group profile of skills needs . 
is: (Choose one) 


1. To insure that everyone: knows what skills everyone 
» Wants to learn. 


2. To determine top priority skills needs of the group. 
\ 


3. To identify appropriate exercises so that individual 
needs are met. 


4. To g e skills trainers information about skills 
‘ needs of the GPS participants. 
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¥ ° ‘ ; % . write in this 
7 on : A a 2 ~ margin 
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a 
. 3. >» When writing’ a force ‘field, the line ee the center’ of 
. : ‘the page r presents: ‘(Choose one) | : = . : 
o 3 act ; i oh ' 
ve ‘lL. The way ings are’ now. , . 


2. +A way to keep: your laces of fordées separated. 
3. The goal. that you wish to achieve. a oe 


»- : cay 


Sh, When’ ane ordering forces in a force: ‘fiedd for ‘importance, tn 
r"importance" means? (Choose one) wis @. oo = 
. _ How difficult ie would ‘be ‘to change the. force: > ag 
“ "2. How much ‘movement there would be toward. the goal ‘Af “ = a 


an : “ . the force were changed.” ee 5 ag 
7 ' 3, .The degree ‘of concern you. a eae force in 
terns. of Erahesng stboue’ change. so? aa : 
8: When rating a: foes ‘for clarity, "ohatity! means? 
-&.  . ° “Choose ons) —, . om ae 
1. How sesiie you feel about the” way this Forde is 
o . working v- 


2. How mich objective data you have about the way this 
force its working. ; . - 


3- How specific you have been in describing how oe 
, believe this force is working; 


The five roles of ‘a PETC-I skills evainee eae 1) Manager, 
2). Facilitator, > ecu 4) Designer, and 5) Trainer. 


All of these réles are carried out in the: context of atroup’ | 
Process Workshop.: The following statements are ‘descriptions of | 
situations which may confront the skills trainer. Each requires } 
the skilts- trainer to adapt ‘a particular role in ofder to deal | 
with the situation. For questions 6-12, indicate: in the space. 
provided the number from those abeve of the appropriate role calle 
for by each:situation. * a 
6 The ‘pagticipants a are listing’ and. se ioeitieine their skills 
° needs. -You are making your own record ‘of -their skills 
needs. -* You plan to do a force field analysis to identify 
the importance and clarity of the skills identified. 


¥ 


You ate preparing to Gonduct a workshop. You have been 


7. 
. informed the session must ’-be coppneted:3 in 4 instead of 
5 days. 1 
* my 
| 
8. You become aware that ‘some members of your ‘@orkehop are 
not quite sure what to do. next. You get the attention 
of fhe whole group and repeat the instructions. 
108: 
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aes a : ae Pléase do not 
Sey : ae writd in this 


“4 ; a - | 


9. __—Your pitc- -1T ceaiadie is complete and your administrator’ 
has asked you to share your ‘training with the staff in 
* one-day meeting. You © agreé : to do- so. 
10. sis Eds time for the first session of the-day‘to begin. . "You} 
s : .discover that’ the person who was to make arrangements for | 


o es mid-agentng: refreshment® has -failed to do so. ‘fs 


Vis 2 _-__ ‘You have eeleowea ‘ake exercises. axid savanmined: the sequence 


a 


in which they sill be cond Pa “9 
12..___——The ‘participants’ are raising questions about/ the approp-. 
~~ rqateness ‘of the exercises you have Sglecte . In the 
seeker Heh follows yous respondby checking your per- 
their needs against the informati 


S ception i they gave 
7 ow you a a r needs: assessitent. eo > NO. 
= , . ee ” 


‘There are five major dimensions along iid ch groups ‘typically grow’, 
and develop. They are as follows: 2 


es 4 a Ee By Pd 


1) Membership 

2) - Influence 

a. Productivity 
)) Feelings” “Ne a are na 
o . 5) Individual differences. . 


on 


Items 13+ 18 are questions that members often ask about, ther 
groups. Identify and write thie number of the. dimension to which — 
each TUEBEAOR is related. in the: space provided. 3 


- 13. When .problems are puieeds is there a value for ‘working 
a them through~ tal eae as opposed to moving peed ! 
; toward action? : LC 
14. How’ do decisions gat, made? - tr 


y 


15. When others like an idea or action, do they say so? 


16. How do others - the group expect me to act? 
: z 5 Le ne oa . ‘ . y f 
17. Is “effort spen aa diagnosing ‘situations to bring out 


underlying =, a 

. aor . ai a 
18. | ‘What opportunities dre there for me to ‘fulfill 

LeadershtP functions? : fe 4 7 


@ 
ERIC ° 


¥ 
ws : “os , > ————_.. 
The Poe sotaeade J for waiting a soblen. statement are@Based on | Please do not 
four questions. For items 19-29, write 1 in the space provided © ie aan 
if the question represents a guideline for writing a problem eae a a 
f ment, or 2 if it is mot appropriate for writing a poe state- 


ment. (1 = = appropriatay 2 = not appropriate). 


. 
~e 


_~, 19. “Who is affected? "of ; 
—- a vf a . 
: t ie oe : { ; ; | 
20. Exactly what is wrong? ae. wt a : 4 : 
. . : c ; ; t ; 
: - a | re, . 
21. How did it become a problem? ae 
— a : ; 
tn. é _ ns i 
22. . How did you discdver.it? . : 7 ~~ : 


“Ay 


a 


23. Who is causing it? 


~ : ° xe a, 7 ee 


“6 
1 


24, What fkind of a problem is it? a, 2 . 
. Ws | = \ , ; 
25. Who should solve it? —_ r F 
\ ¢ . i : 2 ° ‘ 1 
26. How can idvbe solved? : ‘§ 2 
fe a " a 7 ; ; \ ' f . 
/ 27. , How many goals are there? * ade Se 
a. ; = : at j A a 7 : , = : . . 
28. What is. the goal for improvement?” .- — @ ; i 
& © iss a Zé 
__How “will SS measure change? ° 
— Indicate which of the following definitions is: the BEST 
4 definition of the term "hidden agenda." (Choose one) 


au 


1. A goal dtvergent frou. the group's goal. : 
Be ‘2+ Umnstated items that influence group process. 


+ 3. “Individual expectations ‘that may-be at variance with 
| group tasks. we 


ae 4. .Initiation of a-‘different topic while the group is- 
discussing something else. 


. 4 5+. A goal someone wants to accomplish: but ines not state ra 
‘ a openly. . 
1 ‘ _ * - ¢ : 
. 8 : . X aes - 


ec . an. a 


° 


As a PETC-I ski: 


: . - 
a : We : 


° 


3r.- Parapharasing Yano one) 2 


a Quoting as nearly as. possible the person’ who just . 


spgke. ‘ 
- 4 
af Sea the meaning of the person who just spoke. 
3. ‘Repeat ing in your own words the person who just s aa 
32.. Feedback, in Interpersonal Communicatiéns, is defined as 
( occurring when one person: (CReose ene) 


L.* Describes the Behavior’ of another. 
2% ae ts the meaning of the other’ s behavior to ‘him. 


3. Shares -fiis reaction to the behavior of aRGENEY: 


trainer, how ‘eedid. you approach the “folowing 
probl@i situation? Items 33-58 will’ be based on the folsuwsng 
situation: shy. 2 oe, . ; 


ty 


y tae : . 4 
The Problem ‘ y . : 
és : 3. . 
‘Teachers of a new department in a new high school putlding. have 
no knowledge of how to utilize a-team approach to teaching*, « 


The Setting os % 4 : ey beset 
: vt » . 3 in ao 


It is June 15. | The high aeheek in a community of 50, 000 is moving 
into a néw building on September 1. The school has beén construc- 
ted in, such a way as to take full advantage oF the potential gor 


- more open teaching opportunities. — sasiplibay ossible to ‘engage © 
1 ary. 


. teaching. ' 


The Situation : 


in what is being termed an e enpereseceee aaa to 


* - 
One of the new departments in the school will be comprised of the , 
‘old Social Studies and English departments. The title for this~ ‘ 


ment are all from the old units. They expect work as a team, but | 
‘are vague as to the implications of this task. At the same time,» 
as.a group they. have given no evidence of Anclination to work on | 


this problem. Ome teacher, Ms. Williamson, is concerned about the |” 


lack of experience and training of the staff to become a team and 
to plan for and thanage a complete new,approach to teaching and 
‘earning. Ms. Williamson thinks the staff team needs training in 
team building, problem solving and communication skills, ‘Sh 
shared concerns wtih the principal. he principal told Ms. 


‘could be provided. 
y *. 
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‘department will be:"World Culture." The staff of this new depart- 


ts. 


Pl 
wr 
_ma 


eake’ not 
in this 


lll 


The Staff esa _ / , re eae ee, 
ae : write in this 
e seven staff ‘members from the Ags Social Studies and “Ep atieh: ‘ ee 
dppartments will meet for a one week workshop with the skills - 
r traimer. Ms. Williamsog,\a member of the Social Sypdies depart- Ce et 
-ment, has.made the other staff members aware of the need for this |. ..° 


, workshop. This is Wer secobd year at (this high school. ‘She is 
the only teacher who has h experience in: .tedm teaching as’ ce 
was the mecnod: used in her previous high school. 


Mr. Price, Hex “Lavd, and Mr. Robingon cemprise the sds: Social 
=  S§tudies de tment. Mr. Price is 24 ‘yéars old, and this is his ons a 
Second yeat as a high school teacher. phe exclusive “focus of his |: i 
course is Pwropean History; he strongly ‘believes in the "tried and- die 
-true' gethod of presenting-history in chronological} order, and Do 
rae reer as having firm control of his classroom. Ms. Loyd " , fe 
‘ te es American anes and used a democratic approach to teach~ 


LL She feels that students learn best when they are presented 
Ee overviews “of. key concept upon which the "facts of histopy are er: 
“ hung." Mr... Robinson is the World Affairs teacher; his method of | : 
cal teaching is the discovery method 4nd can est b descr ibed. as, ye. 
"laissez faire." . Many teachers have comp ained of Mr. Robinson's | ~~. 


‘noisy classts; he has defended himself. by saying, "When students , 

become excited about something, they'11 becomg. noisy. And more. a fr 

_ than anything, I want my “students to be ex ed about their work." Ck 

Mr. Robinson is re Strong advocate for the inclusion a anthro 
an 


a 


pology» sociology psychology anES. She curriculum. ie re 
or The’ ‘English department is comf sed SE Mr. Chaitovitch, Ms. Dean,,. - 
3 and Ms. Howard. kre Chaitovitch views himself’as the grammarian. 
“of t department. He feels; grammar is,an important but under- 
rated aspect of English--long suffering\from a histo of poor, 
‘boring, and unimaginative pregentations.\ He spends mast of, his 
free time divising ways of making grammar exciting an interesfing 
for the students. Ms. Dean j a classicist from the word go.” Her 
students ate required to re&ad and report gn books from | her. pre- 


..  seribed list of required reading. Ms. Dean feels that ‘frequent 

ahd ‘long essay tests are the. best method for inspiring students 
to study hard and to gauge ut quality of their work. Ms. Howary” 
on the other hand, emphasize modern literature. She has recent 
come under, severe criticism for, prescribing beoks and authors stich 
as James Baldwin, Henry Miller and Kurt Vonnegut, which are: un-. 

'. aéceptable to certain elements in the community. 
33. '___ Choose which ONE of tof the pres problem statements would 

~~ be the ERS? sealer fe) the preceding problem ertune ton. 


haves inhibited th& development of.a team approach to 
; teaching. It will\be necessary to provide similar ex- eos 
ae ' periences and develop a common philosophy for the team 
approach to , Proceed. 


f : és “ 
x . - e : . 2 * 
4, z bs 
is se : ~ 


c 7 1. A diversity of hor philosophies and seseeiences 
1 


v 


e@ . 4 
ERIC = 


ee need to 


| Please do not 
twrite in this - 


of the World culture department needs. to become 

e implications of Being a teaching team. They 

‘dentify.and work on issués that will arise as a_ 
result o increased awareness of this educational ap- 
proach. ‘The ‘staff appears to. need skill crateene. in’ 
order.to be effective> — ‘ 

3. The. principal has been puke. “in the position where: he is 

~ responsible for organizing teaching teams for'.a new 

World History department. The new department will in- 
clude staffs from the current English and ‘Social Studies 
departments. He has had no. experience with-team teaching 
and does not know how to proceed. He feels ‘that training 
“in group process skills will help’ ene teachers: ‘form. 


x The st 
a aware’ of | 


‘a 


> Geen. rae a “Ry as a > | 
a we 
; 4. : The: staff edache of the. English and. ‘soeial Studies 
..* |" .departments: reed ‘t aining in tea building, -problem 


solving: and commuflicat ions skilla fh order’ to learn how 
to use a team roach to teaching. The staff will meet 
for: a one Week workshop with the skills trainer. 


. 


> As skills ‘trainer tér this group, you plan to do a force field. 


analysis Of the s{tuation described above. 


below, questidhs 34-42, mark the appropriate category for each 


‘Do not make inferences beyond the data in the writ 


force in the space provided. —_ 
, ae 


® 


1, Force for change 


- 3. Force that is neither for nor against - 
change, or is not particularly relevant 


| : to the above Qruation 7 


Force against change , ‘ 


£ ten account of 
the ‘situation, ms 


op oc: iS 
3h.*s "Se teachers are expected to work as a'‘team 
ee ee . SY _ oe . 


35, : The teachers have strong, divergent opmitens about, how 
“ teach. - 


‘<) 
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36. . Ms. Williamson has had experience ostiine on’ meee 
, teams.” 


37. Professional jealousy exists among the teachers. | 


Bas + 


“ 


‘418 


For the - forces listed 


4 


+ 
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- ie : cs 
~ 5 oa 
38. _The design of the. building encourages the team approach. 
. : a us » = . / . 
39. Team teaching is ketter for kids and /is: easier to use 
. . coe, . g ~ 
40. There'is an age lag withi @ faculty. - 
_ 3 ae 
6 41./ There isa broad diversity of individual resources. 
yy * \ ’ . 
os ; © ‘ 7 wtapey : 4 
a a . : aoe ak 
~42.. The teachers are not.committed to a new teaching style. 
. 2 > 7 . « 3 ‘ ¢ . 
‘ “Ta his: first meeting with tite GPS group, one of t8s{ participants 
tells the skills trainer, "In our group, nobody g erie a 
chance to finish what they are saying before sonshads Bets in. on 
top of them and starts talking about: sone iene else" - 
“43. Which ONE of the. following statements would be the BEST 
: way to paraphrase the preceding statement? 
1. You think we need ‘more time, to hear and understand 
e people when the 
‘oe - . ’ e 
2. Do you mean thas lu are 30 intent on what you want 
_ to say that yoy don|t listen to who is speaking? 
3., Are you saying thag jyou don't feel/that anyone- 
. this group is Tistening to eac other? 
4, Ifgysounds to: me that intatruptdons are a real 
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roadblock to ‘group product y. This is an 
example of hindering behavior. _ 3 


to answer? (Choose one) 


a 
; needed as well as the skills being used? 


Is each member of the ghoup aware ‘of the skills 


. What are the expected outcomes and- the peecent: 


level of skills, and what, are the ‘skills that 


_need-to be reveloped? 


Are group members able to allow other members 
to express divergence without "laying their © 
trip” on them? . 


How do I get on board with the system and get 
them to start listening to each other? 
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When assessing this group's skills needs, what would you, 
as the skills trainer, consider the most crucial question’ 


we , : = ess ae Please do not 
es Questions‘ 45-48 describe four, roup exercises and their Ny write in this 
= As skills trainer for the grogp described above, which of the a da 

exercises are appropriate and which ‘are infppropriate | for~ the 

“needs indicated by the situatilon?, For each question, mark in the © 

* space provided using the following: 


vi oY 


’ Lm Exercise, is appeopeiate to the group 


2. Exercise in not appropriate to the group sit ation ? 
« 45. Leadership Patterns = To observe a practice’ various 
ao - | “= - leader. behavgprs and to assess 
Z - their effects on ‘group interactton 
. Lo -= To identify, helping and hindering 
~ . f ed behaviors 
\ . .. “ 2 
. 46. Speaking Precisely _ t6 sharpen listening and saying “ * 
Sig a — y nee 
3 . Poo. oe dentify helping and hindering 
; . . - ership a ee 
47. introduction to . - To observe. and i tify task: roles 
: Group Roles ces ‘and maintenance roles needed for 7 
& so . group achievement se 
/ “ . ., = To become self-analytical ‘of con~: 
: |, tributions to. group effectiveness 
.48. ."___ Group Pressure ~ - To focus attention on ways groups ; 
‘Toward Uniformity ‘function to obtain conformity | ll ws 
: - To identify s in which group 
' members int ial Price: 
- To study the™ “behavior “of individ- 
, «als being pressured to conform — . i 
- =.To: sharpen awarendse’ Of group 
interaceton: ; 
After completing the first chee aeusions;,. the” group seems dissat- 
isfied and uninterested. -Group members make remarks such a6: , 
"Why are-we doing these exercisés anyway? Tell us what we’ re sup- 
posed to be-learning. Do we have to have more oe those: meetings? 
« How does this apply to our situation?” ' 
The skills trainer responds by saying: "Don! t worry, I know what. 
I'm doing. I' m ,sure -you"ll understand this in time. I know what 
things are best for you." Or say, "What: had the team dens that : 
would cause such a reaction?” to, 


< 49, Choose one of the following statements that: would be’ the 
“most likely thing the skills trainer, had done incorrectly. 


1. The skills. trainer didn't clearly eating purpose(s). 


He did not allow the gtoup sufficient part in the 
eteenones process, _ ; “fo. 


| ‘e 2 a 120 a 7 115. 


2. The trainer should have sada the Erdup to the 
"do-look-learn" system for the long range goal of 
learning skills, not the ‘Short range eet of. Solving | 
the proerem: 


‘3. The ‘skills trainer han wade assumptions which. hinder 
the group process; she. generalized ‘instead of “just 
netere for. himself. 


poh 
Ww. 

_ | 
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ITEM-TOTAL CORRELATIONS, 


Appendix: F: 


PETC-I KNOWLEDGE TEST 


Q 
td 
4 
. 
NN 
. 
é 


Table, A a 
: va 


Correlations Between Original Total Scores | 
and Retained Items and New Total Scores and 
Retained Items, PETC-I Knowledge Test 


. 26185 
- 37149 


. 38564 
.31131° 
.32365 
30248 
. 26509 


. 31064 

£21492 | 

. 26509 

. 27883 

22639 

.41004 

. 26509 

4 2776 

eS 25454 

. 25256 


@ : : . of 
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Table B: 


zt ’ 
ee «4 | Téem Total Correlations for’ 
Discarded Items, PETC-I Knowledge Test ' 
Question . : Item-Total Question © : Item-Total 
Number Correlation Number . Correlation 
Ta 06345 -..09032 
| 3 | 06335 -.04984 | 
: | g - 94029 * .17645 
oy 7 . -,01651 | =.01771 
| me 10176 02693 
‘i106 @ 08256 ~.08199 
ee Gre oS 2 #19106 
. - 412 Po 4777 s+ -,09933 
| ce is Be -..12334 417645 
Po ap oe -.00243 £04454. 
i 248 Ve 11257 - .17953 
| ‘t ; me Ols7ns 14387 
:) 27 “15985 05121 
28° 15985 . 05456 
29 oe .11257 - . 16187 
30. ey -.17405 | 
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Table C 


Number and Percentage of Participants Who Responded 


‘Correctly to Items on the PETC-I 
Knowledge Test by Group §-. 


+ ey 


-0 
0 
8 
8 
8 
5 
8 
-0 
5 
-0 
8 
5 
0 
3 
8 
-0 
3 
-0 
23 
3 
5 
8 
8 
23 
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Appendix .G: 
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GPS FINAL QUESTIONNAIRE . 
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GPS FINAL QUESTIONNAIRE 


Trainee! s Name . 


Trainee Identification Number ge Ay _— eg i, 


Trainer's — a ee a # 


Please do ot 
‘write in this 
‘| margin 


|DIRECTIONS: For most of the questions. that follow; | 
please give us your honest appraisals. 
by making a mark "X" in the space that 
best represents your opinion ; 


-A. To what extent has this workshop fulfilled your eoceeat tone. 4 about 
what you personally might ae out of it? 


1. Hag not come . Has exceeded my 
up to my / f/f fs. 1 -f  / ~ expectations 


expectations 1 2 3 4 5 6. 
26 - What exactly has happened that brings you to this conclusion? 


é . 
‘ . 
- 
a : ‘ 2a 


’ 


B. Think for a moment about the informational materals, practice exercises .. 
ahd methods used in this workshop. All in all, how would you rate 
them? (CHECK ONE BOX IN EACH LINE) oe / 


3.° Only restated or 2 . i Sas 


proved what IT /_/ / / _/__/_./. Offered new insights, | + 
already know i 2 3 4 5 6 . new ways of viewing 
— old problems’ , . 
4. Spoke to . eo ve a 
Af important . -  /__/_-/_/_/__/__/ Missed the important: 
issues, vital ' 6 5 4 3 2.1 issues, ,vital. concern 
concerns - 
5. Hard to an Clear,’ concise, . 
understand — /_/_ f/f /__/ | Ssounderstandable | 
complex, full. 1 2 3 4 5 6 : 
of "jargon™ 
6. Ideas, skills, * Usage would require ° 
methods can changes in conditions 
be‘ used /_/ s/s /Sstthat I have no contro 
immed tately indér 6 5 4 3 2 #1 over . 
existing conditions . , tow 
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Final Questionnaire 


,7. Little "how to" es a '. Provided real ek 
help for my > : . Mies "how to" help ‘| margin 
actual,group) /_./ / / / for my actual 

wT es 1 2 3 4&4 5 16 ., group work 
ae. 2 eee yo Material failed to 
| et eee ee ee A ae interest me 
my interest oe bf & fF 2: 1. 

9. Demanded much = os Demanded soroeleinal / 
original -° / f/f  / s/s thinking . 
thinking © 6 5 4 3 2 1 : 

10. Practice ' > - -  - Practice exercises 
exercises were./  /  / ./ kK /:_ / SC were of great value | 
of little or i 243 6,5 6 
no value , : a 

ll. Session time . Time in the sessions ; 
was well used /_ /  / _// was wasted. ka a” 

> 6. 3 2 ks ' se 

12. Structure use- ; v5 Too structured, , 

ful promoted /_ /_ /__ / _ /  / blocked learning 
learning 6.5 4 3 2 1 "oe 

13. Gained new : — . Learned nothing new 
insights about /_ /—/ = /  / / about my style of 

» my style of 6 524 3 2 #1 working with others 
working with others 
14. Allowed time : a Did not allow time 
for reflection /_ / / ~/ / /__/ for reflection 
about self and 6 5 4 3 2-1. about self and 
personal growth , : personal growth 
rr : 
C. Considering this workshop as a training program for colleges and i 

school districts: . (CHECK ONE SPACE FOR EACH QUESTION) i 

15. How wouldayou rate it in terms of its potential for school | cea. 
_ improvement? 

- ‘Low potential /— /  /_ /__/__/_/ High potential \ . 


1-2 3 4 5 6 


education courses you have taken? 


° 


ca eee ee 


| 
DF 16, How would you rate this workshop compared to other professional | 


Very low b 20 2h 4 EOP, Heer neh 
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Final Quest4onnaire ‘ 


Please do not 
write in this 


D. Receiving Skills Training - ro . ee margin 


17. In an. overall assessment of your training experience, was it: ' ‘ 


Extremely : 7. + Little value, no 
_. .waluable,_ _ learning accomplishe 
. worthwhile - | a ae ee een ee ee . 
*experience. 6-5 -4.3 2 1. 
Much learning ~° - a 
accomplished . ho oe t 4 


What are the major factors contributing to your assessment? ie \ 
i ' . > 


if : 7 » 


_18. What were the specific learnings for you as a result of your 
training experience? 


"Se ff ‘ ian ; : 
. 3 


of problems, if any, did you encounter? 


{ 

19. Problems arise in almost every training experience. What sort , | 
5 

| 

| 


E. In all honesty, how much do you plan to use the ideas, skills and/or 
materials presented in this workshop as an integral part of your work? | 
7 ee . . Not at all 

20. Extensively ae ct ae oe oe 


21. How do you think. this workshop experience will be of value to © 
you in the future? . 


es Ce 
: \ 7 | . - : La? 


~ Final Questionnaire .. ; . ee 


_F. Now that the workshop /course is over, how would you sum up the 


experience? 


22." 


23. 


25. 


26. 
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° § . Travel costs J = 


'§ Room and board 


Not very | oo Extremely 
worthwhile / / / / /  |/  / worthwhile 


What are the major factors contributing to your .assessment ? 


t \ 


a 


Which of the following costs did you: P tear out of. . pe own pocket 


in order to attend this aca si If so, please é 
amount. 


&> 


$ “ Tuition or fees 


’ 


$ ; Other ae (what?) 


Did you give up potential income {n- asee to attend (e.g., other 


jobs)? 


l. No 


Considering the costs (e.g., monetary, time, etc.) that you 


incurred in order to attend this workshop, how do you feel? 


l, _The costs were too great compared to what I got out: of Nit 


2, “The costs were about right for what -I got out of it. 


The costs were small compared to what I got out of it. 


Additional -Comments: 


yo 


. 
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imate the 


2. Yes. If (i please give an estimate of how much $ 
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Final Questionnaire ae 
7 . nes Please do no 


~ “a 
; : : rie "| margin 


G. Please circle the response that best reflects your opinion of the 
following.characteristics of the workshop. 
27. Pleasg rate the goals and djegtives for: . : Z ma 
ee . a . : 
a. Clarity . : 
a wot = , “ Barely | 
* : Excellent Good Satisfactory Adequate Unsatisfactory 
on 8S 4 5 «tq 2 1 
b: sigifttcaned/ Importance wos 2 \ 
¢. . . 7 sgn | 
a Barely . § 
‘exellent Good Satisfactory Adequate Unsatisfactory ~ 
J ae: 4 — a 4 : 
; 28. Pledse ate sthe workshop content: Skills, concepts, principles, ;. 
: 4tid. values for: 
Veg 
a. Ap opriateness for your hecseeinace and understanding 
re as : | 
oe 4 yO ge . Barely 
. Exdellent Good Satisfactory Adequate. Unsatisfactory | - 
es 8 SO a) (OS . ae 4 ~ ' 
b. nye for’ learning 
: ; 
yee hy » Barely 
ea Excellent Good Satisfactory “Adequate. Unsatisfactory 
fo ea 5 4 B.2 Ye @ ; 1 | 
"Fle cae | | 
"Cet? Clarity of presentation and definitgon ' 
- . Barely 
? Excellent Good Satisfactory Adequate Unsatisfactory 
5 4 ° 3 2 ae 
d. Parsimony (little or no unimportant or not.useful material) 
. Barely 
Excellent Good Satisfactory. Adequate Unsatisfactory 
5 4 3 2° ; 1 
: _.e. Practical significance 
Barely : : 
Excellent Good Satisfactory Adequate « Unsatisfactory 
5 4 3 2 oe 1 
: 129 
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Final Questionnaire a id 
29. Please rate the workshop methods/strategies/procedures 
for: oy uae ——. 
a. Appropriateness for learning 


XN 


Barely 


: : Excellent Good Satisfactory _ Adequate Unsatisfactory 


5 2 1 


b. -Practical usefulness in learning process skills 


a = . Barely. . - 
Excellent Good Satisfactory. Adequate Unsatisfactory 
. 5 4°. 3- 2 | 
c. Efficient use of time 
. , - a 
a D ie  Barfely ene. 
Excellent: Good Satisfactory «Adequate Unsatisfactory. 


a care 2 | 1 
30. Please rate your workshop trainers for: 


a. Clarity and relevance of presnetation 


Barely 


Excellent Good Satisfactory Adequate Unsatisfactory 


co 
5 4 - 3 2 . 4 


b. Sensitivity | group skill needs 


+ ; ae ; Barely _—>— 
%. ' Excellent Good Satisfactory. ,:Adequate Ungatisfactory 
: . 5— 4 3 : O° . 23 da 
o ry F ~~ . cra 
c. Knowledge of content ayba — ; se my 
‘ . — a8 _, Barely are 
Excellent Good Satisfactory Adequate Unsatisfactory . : 
5 4 3. 2 Ho 4 


d. Preparation and organization * 


e Barely oes 
r. Excellent’ Good | Satisfactory Adequate | Unsatisfactory 
5 4 - 3 2 Bee. 2 
d At 
e. Effectiveness*in improving trainee skills §%: °:,. 
é + i 
| : Barely = 
. Excellent Good Satisfactory Adequate "Unsatisfactory 
130 oS. 4 3 » 2 al 


: 1 32 ° | = i 


~~ 


Please 


' write. 


te a re ee ee ee ee. 
> 
é . 


ae en oS a nN ee et oe cn ee pe ee 


margin 
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Final Questionnaire : _ : Ss ; 

; : : | please do not: 
write in this: 


’ margin 


a f. Self confidence and ease: of presentation 


. : - Barely . 
Excellent Good Satisfactory Adequate Unsatisfactory . 
ee he 3 “ae 4 


yw we : 


31. will you have the opportunity to actually use the kind of proces 


skills taught in. Gre? . ‘ 
1; Yes : 
2. No (Why?)_. 


‘3. Uncertain (please explain) 
; ~ . . = : . . . i _ 


‘ — 
32. Do you think time scenlemanes and pherequisites for GPS _ ‘ 
r ‘are excessive? — . a 
i. Yes, definitely; coulf be reduced somewhat Fi 
"oe ee they are demanding but idecessary _ 


3. No strong opinion either way 


33. Do you believe there is a need in the educational eoanneity 
for educators with group process skills and abilities? 


> 


CHECK ONE: 5 "Definitely strong need’ 
| 4 ___*Probably some need 
3 __ Probably not much need 
2 __ Definitely no'need 
1 ____No, opinion , 
34. Please rate the potential of GPS for meeting such a need: 


CIRCLE ONE: Excellent Good ‘Fair Poor None 
5 4 3 2 1. . 


ty 


35. Would you recommend this workshop to a friend whose interests 
are ‘like yours? 


Yes recommend J. _ /Definitely 
it highly. /, fe ff J ff § not recommend 
. ry . / 6 J . 
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‘GPS KNOWLEDGE TEST: 


Name ; ” ‘ ' = _ Please do not 


———— _—- — write in this 
I.D._, Number i fs ft I f_ef: , ; 
; — 1 “ 3 4 5 6 . 


Trainer : ; : “$ 


. margin 


a 
al 


Site 


Date... 


Instructions rae 
; w 

We have designed this, test to hélp us assess to what dagtee parti- 

cipants have learned the maf@r ideas and skills presented in the 

GPS Instructional System. It is intended to evaluate the system, 

- NOT YOU. Your responses to this test will be” completely ~ : 

confidential, — 

' Each question has a group af responses : Siem which to choose your 

answer. Please indicate the response which you think best answers 

the question by either circling the number ne#t to the response (as 

in Question 1-3) or marking the number for the correct response 

in. the space provided next to the question (as in ee 


You will notice beneath each question number there is another 
number which is underlined, e. g-, under Question 1 is an under-~- 
lined twenty-five, "25." Disregard these underlined: ‘numbers ; ey 


are there for NWREL's s data analysis process. 
3 


1. When writing a force field, the line down the centezx of, 
25 page represents: (Choose one) : 


—7 { 
1. -Thé way things are now. 
2. Away to keep your lists.of forces separated. ; 
3. The goal that you wish to achieve. 


* 2. When rank ordering forces in a force field for importance, 
26 “importance” means: achoose one) 


1. How difficult it would be to change the force. 


4 
2. How much movement there would be toward the goal 
if ene force were changed. 
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an. 


The degree of concern you feel towards the “force in terms 


of bringing about change. 


3. When rating a force for clarity, "clarity" means 


(Choose one) ‘ 


1 ie 


4 


The four guidelines for writing a problem statement are based on 
For items 4-14, write 1 in the space provided if 
the question represents a guideline for “writing a problem statement, 
- or 2 if it. is NOT appropriate for writing a problem statement. 
_ (1 = appropriate, 2 =-not appropriate). 


four questions. 


Who is causing it? 


How can it be solved? 


’ 


How positive yeu feel about the way this force is 


working." 


Pad ; 


How much, paces data you have about the. way this - 


force is working. 


How specific you have been in describing haw you 
believe this force is working. 


Who is affected? 
- _* Exactly what is wrong? 
How did it become a problem? 


How did you discover it? 


What kind of problem is it?, 


___Who should solve it? 


“How many goals are there? - ; au 


What is the goal for improvement? 


* 


za 


Please do not 
write in this 
' margin 


14. 
38 


15. 
39 


; 16. 
40 


Please do not - 


SK a ne 
. : write in this” 


Hoe Sg ‘ -  gargin 


How will you measure change? 


“Indicate which of the following definitions is he BEST - 
definition of the term "hidden eee (Choose one) % 


a. A godl divergent, from the group's goal.- 
2. Unstated items that iaeiuence group process. 


3. ‘Individual expectations ‘that may be at variance with j 
group tasks. 5 


4. Initiation of a different re while the group is 
' discussing something else. : 


5. A goal someone wants to accomplish but does not state © 
‘ openly. yy. 


Paraphrasing = (Choose one) 7 


1. Quoting as aeatiy as possible the A Porecn who JURE 
spoke. C) 7 


2. Interpreting the meaning of the person who’ just : 
spoke. aii ' 


°3.. Repeating in YOur own worde the person who quer spoke. 


17. Feedback, in Taterpersonal Ceeniitcelons is defined as 


“a 
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occurring when one person: (Choose one) 
1. Describes the behavior of another. ~ 
2. “Interprets the meaning of the other's behavior to hin. 
x ‘Shaves his reaction to the behavior of another. 
_ 
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Table A- 
Correlations Between. Original Total Scores and 
ae Retained Items and New Total Scores and 
' Retained Items, GPS Knowledge Test 


Item-Total Correlations — 


Question a: : os ir me -_ 42 
Number _ Original Scores (17 Items) New Scores (15 Items) 


. 30215 
.08975 
.14826 
230779 
.26913 


45176 

£44865 

. 32074 

«24096 

. 3000 

.37021 
_339215- 
33698 
32320 
. 20024 
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Student Activities Questionnaire 


“The Student Activities Questionnaire was constructed for the 


evaluation of an ESEA Title III project, Project IMPLODE, which was 


hypothesized to impact upon chassroom climate. “It was designed to 


emphasize the a of the classroom process: rather than its input to 


the educations. -—— That is, to determine the traits or abilities 


‘of the students. A description of the item generation and piloting 


procedures is presented in "The Measurement of Aewieaie Climate ‘in 


Elementary Schools" (Ellison, Callner, Fox and Taylor, 1973). The 


77 


questionnaire contains sixty multiple-choice items and eight scales. 


the eight scales havé: been used for the ITCP evaluation work. 
One scale of the Student. Activities Questionnaire was dropped because 
it = de igned as an implementation measure for Project IMPLODE. 
Hence, it was not expected to be relevant to RUPS, INF or GPS training. 

, 3 
Two additional scales (Career Development and Independent Development) 
were judged to be of low Fajevance to the instructional systems 
developed by the ITCP. The scales which were used included: 


Enjoyment of School: A measure of students’ enjoyment 


of class activities and school work 


Reinforcement of Self-Concept: A measure of the amount 
of positive feedback received by students, either through 


personal contact or structured class activities ¢ 


Classroom Participation: A measure of student participation. 
‘ in class activities--frequency of class discussions, 

number of students who typically participate and 

opportunities for participation 


Democratic Classroom. Control: A measure of the amount of 
student input into classroom decision making, planning of 


individual activities and enforcement of rules 
Individualifation of Instruction: A measure of the extent 
that students perceive their teachers as sensitive to their - 
own individual needs, progress and goals 
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Published psychometric data for the Student Activities Questionnaire 


Pa 


consists of scale intercorrelations, intraclass correlation coefficient 


. 
. 


for each item and aceteten cénstruct validity evidence in the form 
\ = 
of treatment and comparison group differences. 


With a sample of 654 fifth and ‘sixth grade eeadenees 2 seaie inter- 
coveaiar tens of all 8 of the SAQ scales vaihcad from 14 to a 49, except 
for the multiple talent aching and career development scales which 
contained some common items. (These two scales were not selected for 
bine evaluation of ITCP systems.) Of the five scales selected for use, 
the interscale correlations ranged from 14 to .42. The mean anterscale ‘ 
eotrelation for the five selected scales was -26 as opposed to the mean 
interscale correlation of .35 for the full set of 8 scales on the 
ae Student Activities Questionnaire. This indicated greater: scale independ- 

dice among the five scales used than among all ‘eight of the scales. In 
other words, the more redundant scales were not used. -., ° 

Peete eerbenditey information in the form of intraclass correlation 

coefficients is available on all of the questionnaire items. Of the 


intraclass correlations, 33 were significant at the .01 level, 8 were 
significant at the .05 level, and 18 were nonsignificant. Of the 5 
scales selected, 15 intraclass Rs were significant at the .01 level, 5 


- were significant at the 05 level, and 9 were nonsignificant. The items 
eas 
a sejected appeared to be neither more nor less reliable than the: complete 


set of 60 Student Activities biuseis fontiavecitens: 

Additional construct walteteys evidence ayaa re for the Student 
activeres ee ee is that mean cenpariscas between the experi- 
mental and contest schools in the Project IMPLODE evaluation resultéd 


in significant differences in the expected direction in all scales 


except individualization of ihstruction. 
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Student -Attitude and. Activity Survey (SAAS) ...% < ia 


a 


The SAAS was developed as a part of a Utah ESEA, Title III Project, 
the Utah System Approach to Individualized Learning (U-SAIL)- (Nelson, 


1973). Tt was developed to assess outcomes of an affective mature as 


o 


well as student ‘perceptions of i certain process considerations. Many 


1 


of the acaies of the SAAS were developed to" conceptually parallel the : 


concepts measured with the Student Activities Questionnaire. There 


“ are two forms of the SAAS, a Primary Form appropriate for. Grades 2 


through 4, and an Intermediate Form intended for use with Grades >, 

and 6. There are 17 scales included in “the SAAS. Many of them, how- ~ 
ever, were developed as measures of Amplenettation for | the U-SAIL proidht 
and were not appropriate for evaltation of the three instructional 
systems.) = 


The scales which were used include ‘general climate, retutoreeneat 
of self-concept, general s school sentiment, use of process approach, a 
eabtteiserion in individualized learning stratebies.. All of. these 
scales came from the Titecmediate Form of the SAAS.. 

Published reliability information on the, SAAS is limited to 
Steainuittes obtained ina Punkebdndivata of ‘the SAAS variables. The 
reported communalities range from .71 through -77. There was, however, 
no reported reliability esttndte <oE the use oF prodeus approach 


ry 


variable. 


My Class Inventory (MCI) © ; | 2 


The ‘MCI was developed to conceptually. parallel the Learning 
Environment Inventory for, elenentary Level school children. The 
complete MCI includes 45 items’ in 5 scales: satisfaction, friction, 


competitiveness, difficulty and cohesiveness. (The difficulty scale 
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is not being used in the ITCP evaluation work.) The scale reliabilities 
of the MCI nepeed from .54 through -77, based upon an analysis of data 
from a sample of 655° subjects. There was no validity information reported 
in the manual’ for the MCI (indevnats. 1973), for it was still in develop- 
ment at the time it was selected pox use ta the evaluation of the ITCP 


SN: 


training system. 


Student Behavior Description Questionnaire (SBDQ) 


The SBDQ was developed’ to assess the interpersonal needs of high 


school and junior high school students (Croft, 1966). Although the 


complete SBDQ taps interpersonal variables in terms of relationships 


with parents, friends and teachers, only the three scales measuring 


relationship with teacher factors were used in the evaluation of the 


f 


- 


three instructional systems of the ITCP. Student perceptions of 
relationships with parents and friends are not likely linked - the 
training offered in RUPS, GPS or INF. 

The SBDQ was developed primarily through factor analytic technique. 


Thus, the scales are relatively honogenous and independent. 
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INSTRUCTIONS FOR CLIMATE QUESTIONNAIRE "~ “ 3 
WINTER 1975 | 


November 28, 1974 


, 


Dear’ P 


5 Py teacher at your school is 


Sarticioaring in a workshop: on interpersonal and group processes next 


fall. The workshop is sponsored by the Northwest Regional Educational 

Laboratory (NWREL) in Portland, Gregon. As part of the evaluation of ° 

the workshop, NWREL is administering a 30 minute climate questionnaire ~* 

to the students in this teacher's class both this spring and next winter. 
has indicated to us that you will administer the. 


questionnaire for us. Because we are asking children..about climate; it 


is very important that the teacher not be in ‘the. room ‘when they answet. 
the questionnaire;.-therefore, if you canfot administer the questionnaire 
during the next several days, please call me. (COLLECT). and’ I will make” 
Brnoneeten for NWREL staff to administer. ‘ite : ; 


Two ferns of a climate questionnaire are faeluded for ‘chis class. Each 


‘child answers only one questionnaire. The questionnaires are alternated 
oo ge. ‘every other student will receive the same form. There is a separate 
answer sheet for the questionnaire. Please make sure that the children 


use #2 pencils on the answer sheet. 


When administering the questionnaire, please read the directions on the 
first page to the students and have them read them with you. When the 
students mark their answer to the second example, check that they have 


correctly marked the answer sheet at question 80. The children should 


be allowed to ask questions at any time--please answer any questions 
about procedures, meanings of words, etc. (If several children do not 
understand a word, a note to us would be helpful.) 


After the students finish the questionnaire, please collect all ques- 
tionnaires and answer sheets and return them to me in the enclosed... 
envelope. Please do not show: the teacher the answer sheets, although 


‘the teacher: ® Lay look over \the tests, if desired. 


Thank. you" very much for your cooperation. If you have any problems or 
“questions. please call. 


‘Sincerely, F _ . 


_ | Suzanne B. Hiscox, 
‘ ; Senior Evaluator: , " 


io | 14 "7 


INSTRUCTIONS FOR CLIMATE quesizownarRe ADMINISTRATION 
Cait nae : a a oe * 
“ia Fa . bs te s 
Enclosed are copies of thg’ Gilace Mesticnndat® ‘and dnswer sheets 
¢. that are to be. used as part if Fan ‘évaluation workshop for two instructional 
systems from.the Northwegt--Regional Educatignal Laboratory. Because 
the questionnaire asks.,, 3qut* classroom enviroriment’, . it is important that. 7% 
the teacher not be ing¥ bbe, ey tpom while students are. angwering the questions pi 
al . Two -forms of e clinaeg Guedtioniatre are’included for this class. 
Each ehild answers only one. questionnaire. The questionnaires are 
alternated so every other student will receive the same form. There is. ‘ 
a‘separate answer, sheet for the questionnaire. Please make sure that 
‘the children use #2 pencils on the. answer sheet that is enclosed. 

. On -the identification portion of the answer sheet, the students 
should give the ‘information for (1) school, (2) instructor, (3) grade, 
and: G) test. férm. ‘The fgxm of the questionnaire (A or B) is given on. 
the ‘front. pagel of ch questionnaire booklet. Please make sure that 
students give homplete informatidn to these questions. Without it, the 
questionnaires cannot be used. It is not necessary for students to 
blacken the letter bdxes on the right-hand portion of the answer sheet. 
You may save some time end EhoupEe by omitting those sections. 


, 


Q 


ben adninis®ring the Giad tone chee: read the directions on: the 

Wto the students ard have the students read them with you. 

"Students tlark their answer to the second example, check that 

' they have correctly marked the answer sheet at question 80. The children 
should be allowed to ask questions at any time-~please answer any questions 
about procedures, meanings 6f words, etc. (If several children ge not 
understand a word, a note to us would be helpful.) 1 


+ 


After the abudents finish the questionnaire, please collect all 
questionnaires and answer sheets and return them to NWREL in the 
enclosed envelope. ‘Please do not show the teacher the answer sheets, 
although the teacher may look over the tests. , , 


Thank you very much for your. cooperation. If you have any problems 

or questions, please call Suzanne B. Hiscox or Dean H. Nafziger collect : 

at (503) 224-3650. wate ee 
Note: When teste were deriv ag pevaluators emphasized” each 


ss potnt in the letter ordi They also pointed out that 
z-  the.sanple item enoula be filled tn box #80 instead of #1. 
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‘ _ CLAMATE QUESTIONNAIRE 


Directions 


FORM A 


The purpose of the questions in this booklet is to find out what your 


_class is like. This is not a "test." Your teacher will not see your 
: answers one you do not have to put your name on t answer sheet. - 


There are two kinds of statements in this bookle Examples of each 


kind are printed below. ‘ 
x 


1. Do you live in Washington? : 
i 


4A 


1. Yes _ : 2. No. 


To answer this. question, first decide if your, answer is Yes or No. 


Then, look at your answer sheet (the blue and ‘white paper) and 


find question 1: With your pencil darken column one of question 1, 


‘if your answer is Yes. 
/ 
An example of your answer would-be: 


“ob 2 3 4 5. _ 
wbodaddda-: : 

Another statement might pai 

80. Teachers are happy. 


1. Not very often 3. Often 
2. Sometimes 4. Most of the time 


SS First, decide how often you think teachers are happy. Now, find 


question 80 on the answer sheet and mark the column for your 


answer. If you thought teachers were sometimes happy, your answer 


would look like this: 


és 


If you want to change an answer, be sure to erase your first answer and 


darken the,column for your real answer. 


Work as quickly as you can. Your counselor will ‘tell: you when to stop. 


PLEASE TRY TO GIVE YOUR HONEST FEELINGS ABOUT YOUR CLASS. - 
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1. The pupils enjoy their sched work in my..class. i 7 — 
“1. Yes 2. ‘No | ~ 
2. Children are ivaye fighting with each other. 
1. Yes . 2. No . 
3. The same people always do the best work in our class. : 
1. Yes 2. No ) 


? 


4. My oe friends are in ‘a9 class. | 
on Yes 2. No a a 
5. some of the children in our class are mean. 
1. Yes 2. No. 
6. Most pupils are pleased with the class. 
l. Yes 2. No 7 
“ 7. Children often race to see who. can finish first. 


1. Yes 2. No 


8. Many children in the class play together after school. 


l. Yes. 2. No 2 : . 
9. Some pupils don't like the class. 
l. Yes © 2. No 7 ° > 


10. Most children want their work to be better than their friend's work. 
1. Yes _ 2. No 


“11. Many children in our class 1ik8 to fight. 


‘l. Yes 2. No , ea 


12. In my class everybody is my friend. 
a 
. 1l. Yes ' 2. No 


13. Most of the children in my class enjoy school. 


1. * Yes 2. No - ; ‘ eS 
14. Some people in my class are not my friends. : 
an : . ‘ @ 
1. , Yes 2. No ; sie 
158 ae 
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f 7 ~~ 


15. Some pupils don't like other pupils. 


AQ + 4 8 
1. Yes 2. No | = deat ane peed See etias aan 


16.. Some pupils feel bad' when they do not do as well as the others. 
l. Yes 2. No 

17.- In my class I like to work with others. 
1. Yes 2. No a i ge 


18. Most children say the class is fun. 


l. Yes a No -* | 
19 .«* Children have secrets with other children in my class ., 


1. Yes © 2. No 


+. 20. .Most children don't care who finishes first. 


| l., Yes 2. No i, : F 
21.° Some children don't like other children. ¢ 


2 oes “8 » 


l. Yes 2.—*No ca , : ae | 


22. Some pupils are not happy in class. 


1. Yes 2 ° No . = . : : : yy 
23. All of the children know each other well. ee 
l. Yes 2. No 
e & ‘ : 7 . ‘ r 
24. Some pupils always try to do their work better than the others. ; 
1. Yes 2. No ) . 
'25.. Children seem to like the class. 
- ¢ 
l. Yes’ 2. No . . ’ 
‘26. Certain .pupils always want to have their ows way. 
1. Yes © 2. No : 
~ , , , ~ Pa 
27. All pupils in my class are close friends. 
l. Yes 2. No ; 
“28. In our a some pupils always want to do best. 
1. Yes 2. No | 
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30. 


31. 


33. 


34. 


" 35. 


38. 


39. 
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, 29s 


A few children in my class-want to be first all pf the time. 4 


Some of the pupils don't like the class. 


l. Yes 2. No 


Children in our class fight ‘ lot. 

1. . Yes 2. No , , ‘ 

All of the pupils ia cay class like Sad aacthery: 

l. Yes 2. No es -_ , : 


Some pupils always do better than the rest of the class. 


“1. Yes) 2. No 


Certain pupils don't like what other pupils do. 


| 1. Yes . .2. No 


l. Yes . 2. No 


The class is fun. 


“1. Yes 2. No 


Children in our class like each oti-er as friends. 


cd. Yes . 2. No 
. * : a 
How often do you have class discussion where many students have something 
to say? . . 2 
.. Haven't done that yet 4. 2 or imes a week 
2. Not very often 3. About once a day or more 


3. About once a week . 


How often do you have class activities where many students take turns 
speaking? 


l. More than once a day 4. About once a week 
2. Once a day | 1 5. Not very often 
3. 2 or 3 times a week 


= : 7 “the 
In general, how are problems usually solved in your classroonf’. 


l. - Our teacher solves the problems alone 


-2. The teacher and the students work together 


152 


40. How often do other students in your class tell you that oa have done _ 
mera good jobt x —o 


1. Not very often ‘ 3. About-2 or 3 time a week 
2. About once a week Tc ae Once a day or more 


41. How often do the students in your class talk to the teacher about how 
much time they should spend on an activity? 


l. More than once a day 4. . Once fe week 
2.., About once a day 5. Not very often 
-3.'°2 or 3 times a week j 


* 42. Do you ever want to continue to do your work during recess or lunch? * 


1. ‘No, never 4. Sometimes during the week ‘ 
2. Almost never 5. Almost every. day 
3. About once a week, or less 


43. Do you ever work on something that other students in your class are 
not working on? 
1. No, usually we work on the same thing 
2. Sometjites, about once a week or less > Ss 
3. Feirly.often, 2 or 3 times a week oe a 


44. Does your class have discussions about how the students should act? 


a 


l. Yes. 
2. Not very often . .. . 
3: No, generally the teacher tells us . » ' 


\ . a 


45. How often does your teacher <r you to try a difficult task? 


1. Almost never 4. About once a day 
2. Sometimes, once a week or less 5. 2 or 3 times a day 
3. Fairly often, 2 or 3 times a week 


46. How often do you talk to a teacher by yourself about your schoolwork? 


1. 2 or 3 times a day 3. About once a week 
2. About once a day _4 4. Almost never 


47. How often are your excited about going to school in the morning? 


.. Almost never 
Once in a while oe the choot year 


1 

2 

3. About once a week 
4. Almost every day 


48. Do you think your teacher knows what kinds of activities you like the most? 


1. Not very well 
2. I don't know 
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50. 


5k. 


52.. 


53. 


54. 


55. 


56. 


57. 
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Does your class have actf¥ities where many 
1. No, haven't done chat yet 3. 
2. Not very often = 


ieee eee fa ee ea 


students get called on?. 


bout once a week 
Yes, about once a day or more 


How often. does your teacher petmit a lot of talking and activities in 


your classroom? 


1. A number of times a day 
2. About once a day 
3. The classroom is usually quiet 


In the classroom, the teacher usually calls on: 


1. The same group of students’ >. 


Almost all the students 


Do you have activities where the teacher has you tell someone else . mo 


about something? 


1. No, haven't done that yet a; 
2. Not very _ 4. 


How often can you speak out in a classroom 


1. Almost never ‘ 4. 


2. Not very often 5. 
3. Sometimes 


How often does your teacher tell you about 
1. Almost. never 4. 


2. Sometimes, once a week or less © 5. 
3. Fairly often, 2 or 3 times a week 


About once a week 
Yes, 2 or 3 times a week or nopé 


discussion when you want to? 
Fairly cften’ 

Always e 

4 


something’ you have done well? 


About once a day 
2 or 3 times a day 


How often does your teacher let students decide how an activity or project 


should be done? 7 
a 

1. Almost never 

2. Sometimes 

3. Most of the time 


How often do you spend less time on Some activities than other students do? 


Ls Fairly often, 2 or 3 times a week 
2. Sometimes, about once a week or l¢ss 
3 ; 


Almost never - 
a 


- 


How often do you spend more time on some activities than other students do? 


1. Fairly often, 2 or 3 times a week 
2. Sometimes, about once a week or less 
3. Almost never 


- 
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58. How much do you like what you do at. school? 


1. I don't like it 3. LI like it 
2. I\like it a little | =—="4. I really like it . 


59. How often do you tell your parents about something good that happened 
in school? : 

1. Very seldom 

2. Sometimes , about once or twice a week 

3. Almost every day 


60. How often do yeu gdp excited about what is happening in class? 


1. Almost never - 

2. Not tery often, less than once a week 
3. Sometimes, about once or twice a week 
4. Almost every day 


61. Have you ever wanted to aay after school to finish up something if 
you could? — i 
: + ie ‘ : : 
‘1. Yes, once a week or more 
2. Sometimes ‘ 
3. No, almost never 


62. Who decides what the class will do? _ 


1. The teacher usually decides by herself what the class will do 
2. We often plan with the teacher what we will do 


6K, Does your. teacher know what is basy and what is hard for you? 
1. No, not very well 


2. Sometimes 
3. Yes, knows very well 


64. How do you usually feel when your teacher talks to you about your school work? 


1. Encouraged 
2. Don't know 
" 3.’ A little discouraged 


65. Are you proud of, the things you do in school? 
Very proud 


1. 
2. Proud of some things, not proud of others” —“~, 
3. Not very proud 
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FORM 8B 


. / 7 
CLIMATE QUESTIONNAIRE _ “ 
J 


Directions ~ 


The purpose of the questions in this bocklet is to find out what your class is 
like. This is not a "test." Your teacher will not see your answers and you 
.. do not have to put your name on the answer sheet. 


There are two kinds of statements in this booklet. Examples of each kind are 
printed below. 


1. Do you live in Washington? 
J we F) 
To answer this question, first decide if your answer is’ Yes. or. No. Then} . : 
look at your answer sheet (the blue and white paper) :and find ‘question be 


With your pencil darken column one of seas al 1, if your answer is Yes’. ao, 
: { 


5 he oa 
An example of hots answer would pe: : in 

12 3° 4, ny ca soe 

y* dosnt. Me gee 8 

Another scatdnent ‘apie be: K ae v. — 

| oon y, 7 Ys “a ; £ ® 


80. Teachers are happy ae a ee 8 
Me 7 ys 

= Not very ee re 

2. Sometimes : A se ‘. 


First, decide how ee you ‘think teachhd at are e happy... Now;” “fing han Hon n & 
on the answer sheet ,and. Mark the co Lumri for your answer. | TE. ‘you ‘tho hr* 
teachers. were’ ares app your gnayet pee look Lite shies, boace 


coped Or 


¥ 


= : ¢ oo 


If you want to Change: ap, answetj be sure to erage you ‘ est afiswer’ ‘and darken 
the’ column for ur: real answer. as a e ; . ee 
r a Nw 
Work as  autly as 9 em. we qunselor wilt telb you =< to stop. -* 
ieee 
ri va 
(Fae Se 
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ao ‘Does your teacher decide all of the work you do each day? 


-1l. Yes -.2. No 


< 


F Do you usually feel good about your work after talking with your’teacher? 
“1. Yes “2. No | 
; 3. Do you ever go back to your room early to work dicing tones 
te Yes 2. No | 
. z.° Does your teacher often ask questions which make you think hard? 7 
1. Yes = 2. No cS 
5, Do you like to come to school? 
L Yes 2. “No .* 


6. Do you feel that your teacher likes you? 


, 1. ‘Yes 2.. No - 


; - a Do you ever spend time in school talking about why things are the ag 
pat ' they are? . ; 
| et Yes 2. No | 
¥ é., When you. have something to say to other children, do you say it? 
ios Yes 2. No | | | 
gt Do you sometimes think of your school as a jail? ’ ‘ 
. “gh Yes ‘2. “No 


to he school a happy place for yon.28 be? 

F ve Yes - 2. No 

41. ‘Do — ever, tell your parents about good things that happen at school? 
Yes 2. No. — 

42. Does your school have too many rules? 


1. Yes 2. No 


“4 z 


/ 13. Do you stay after school and help the teacher? 


. . 1. Yeu: 2. No 
ae | | . 157 ? " 4 165, 
ie ; . < 7 ; ; 


We In ‘the morning, do you feel like going. to © school? 

1. Yes 20 No . — | “ - 

4s. Does soar class biay talk about the good and bad sides of something? 
lL. Yes 2. .No 

16. Does your beaches let you know when you have done your work well? 


-Lé Yes 2. No 


ate Do you (sometimes) feel bad after talking with your teacher about your 
school work? need 


1. Yes > 2. No 
18. Do you ever tell your parents about bad bidses that happen at, school? | 
I. Yes 2. No | 
19. Does your teacher sometimes make you feel bad? 
lL Yes 2. No | es aa: 


20. In school, have you ever cide things in groups . according to. the ways they 
are-alike and different? . 


e 


1 a veg oe No mA 
21. - In the morning, do you often feel like staying home and not like going 
to school? ; . 
. 1. Yes 2. No 
F aL v- ¥ 


22. Do you choose your own work very ercea in school? 
1. Yes 2. No 
. 23. Does your teacher want you to speak ie in class? 
“-l. Yes 2. No oo ca 
24. Are you scared to go to the office at school? 


l. Yes 2. No 


_ ¢ a. 
25." When you finish one-job--do you sometimes choose what job you will do next? 


1. Yes 2. No ; . 
26. Does your teacher always tell you what to do in school? a 
1. Yes 2. No _ 
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a7 5 Do you get a headache when you think about school? - 


- 


l. Yes 2. No 


28. Are you afraid to tell your ‘teacher when you don't know what you are 
supposed to do? a 2 
-— 


és 


1. Yes 2. No . cs = > . : 


29. Do you wish you were in a-different class at school? 


l. Yes. 2. No G 
30. Would you rather stay home than come to school? - ¢ 
1. Yes 2. No | 


. 


By = 


” 


4 


31. Do you feel/get sick very- ften when you are at school? 
1. Yes = 2. No | C ) 
32. I like talking with my teachers. © 


1. Not very often 3. Often | 
2. Sometimes . 4. .Most of the time 


33. Teachers make fun of what the boys and girls say. 


1. ‘Not very often 3. Often . 
2. Sometimes _ 4. Most of the time 


34. Teachers are easy to get along with. 


1. Not very often 3.) «Often 
2. Sometimes - 4. Most of the time 


35. Teachers are very good friends of mine. 


1. Not very often . 3. ° Often 
2. Sometimes 4. Most of the time 


36. Teachers get mad at boys and girls. 


1. Not very often 3. Often 
2. Sometimes 4. Most of the time 


37. Teachers are nice to the boys and girls. 


1. Not very often 3. Often 
w+.  -2.° Sometimes - e ~~  --~&> ~Most of the time ~ 
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38. Teachers know a lot. 


1. Not very often 3. Often | 
2. Sometimes 4. Most of the time 


39. Teachers are too busy. 


1. Not very often 3. ° Often oad 
2. Sometimes 4. Most of the time- — 


40. Teachers do special things for boys and girls. 


‘1. Not very often 3. Often 
2. Sometimes eo 4. Most of the time 


41. Teachers listen carefully to the kids' questions. 


> : z : ‘ 
1., Not very often 3. - Often = 
2. Sometimes “ 4. Most of the time 


42. Teachers make fun of the boys and girls when they make mistakes. 


.l. Not very often. 3. Often 
2. Sometimes — - 2 § : 4, Most of the time 


43. feachers help the boys and girls think clearly aboug class work. — 


: * g 
1. Not very often —— 3.2. Often 
2. Sometimes , 4. Most of the time 


44. Teachers don't let boys and pirls finish what they are saying. 


I. Not very often : 3. Often 
2. Sometimes — 4. Most of the time 


45. Teachers help-the boys and girls with any problems ‘they may have. 


1. Not very often 3. Often 

2. Sometimes 4. Most of the time 
46. Teachers Know what they are talking about.- : ~ ta ° 

1. Not very often 6 3. Oftenv** 

2. Sometimes 4. Most of the time 


47. Teachers are kind and cheerful 


I. Not. very often 3. Often - 
2...Sometimes 4. Most” of the time 


48. Teachers try very hard to teach boys and girls something. 


- 


1. Not very often 3. Often | 
-2. Sometimes 4. Most of the time 
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49. Teachers try to tell bovs and girls what to do. 
‘1. Not very often 3. Often. 
Z 2. Sometimes _ 4. Most of the time 
50. Teachers tell boys and ¢irls about new things they find. 
- 1. Not very often | 3. Often . 
2. Sometimes 4. Most of the time — 
51. Teachers speak in a way boys and girls can't talk back to them. 
1. Not very often 3. Often 
2. Sometimes . 4. Most™of the time 


52. Teachers tell funny stories to boys and- girls in class. 


0 3. 
he 


I. Not very often 
2. Sometimes 


‘& 


53. Teachers tell why they question students. 

_ 1. Not very often 3s 

2. Sometimes 4, 
“a 

on ~ ; 
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Most of the time 


Often 
Most of the time 
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The tandvedaxe Piaggfor the Impreving Teaching Competencies Program 


(see Resource Allocation and Management Plans, 1974) divides the work 


' flow for the dedelopment of an, instructional system into five phases: m4 


.v a : 
Brenntag, pilot, interim, — field: ‘test and outcome. Each phase consists 4 


. 
. 


oe 


Pe 
h 
Hy 
a \ 
ey ‘ \ 


of abedin ‘development,’ tec aiuaeien — relations activities 


. that culminate in a milestone report. -_ 
_ Y 


The ‘Tange of activities associated with everopeng an instructional 
é‘ 


| system is wismanieed in DaseEom I. These activities are divided. ‘into- o 
five major categories :. needs, objectives, product development, testing 

and* ‘implementation. Diagram I also/partitions “these ‘activities among 
seven fyétional shaded: management, dcélopnent, field relations, 


‘digsemisiation, rormanoNe SyeTuneeens deieeeaail ‘gunmat‘tve evaluation and 


external ane evaluation. * the matrix isnot necéssarily 


7 | aw : 

cased icive nor are thé évgluation relationships cong? each part’ 

; \ ‘ . . aoe - . ; ; @ 

.. strictly linear. : ae as ~ 
a t *® i? 7 

The spagific activities engaged in during ane py ee of an’ 


, tnstructional system differ_according to the ie under consideration, {os 


the. unique needs of the specific product or change support process being 
/_ + 
o developed and, . oceasionally, due to style préferences among work unit : 


_ seams. For more specific and ° detailed stitenents, reference should be 


= ” 


’ made to the development and evaluation plans nd < documents. for each a 


work ‘und ie ° - 


’ 


" Evaiwiation differs sonar each phase ee che development.’ i 
‘During the initial phases, evalua on focuses on foragtive issues and 
‘yy. 
. provides information primarily for \ ken developers. During the latter 


Saas 7 ine 2 ae: 


aa, eae is’ on summative evaluation which provides information’ 
oe. _* se : : = : _ a 
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Program Nansgement 


- NEEDS 
| Theoretical Value Approves a documented 
4" pirical need atatonent ant’ 


1, compatible with 
Program and value 
position 


Hiald Desire/Read inant 
Expert Review 
1, A feasible priority 


tor the Program to 
1 _ Undartate, ‘ 


Approves the Caaslbility, 


and appropsletenass of 
ede approaches to data 
ie gathering determined 


oe. necuasiry from field of || 


potential users and 
(ron anperts, except for 


qaterna) tummative os, sr 


duseamant of needs, 


f naeds statement,” 


Coluan headings should be"Pead as functions 
»|(hot roles on parson}. Hiaedings tn Column } 
denote Five, major classes:pf activities, No. 

particular sequence or Tespatal relationship 
it racesserily fmplied. , Entries. should not 
be. read as prescriptive for any particular 
work unit. Again, no particular sequence or 
teparil relationship is necessarily {n Hed? 


. m 
a ee 2 
ees i 
fy “ey os 
: wer ; 
ye, 
vy ba Ps 
: . ‘ [uae 
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LApptova any sterations!? | 


Canmraten'ratlonale 
statemeng including 
theorathtal content and 

atratiglas, valva and * 
may ‘ 


col luboratea'ulgh, 
evaluators on at 


tevdew, Uterature review 


and justification, 


ia Tee 
Initiates. reasteamant of 


teed when.pppcopr iate, 


: ae ‘for me 
41 collection trom ‘dhe a 
This vouldYnclude 


ude 
tolloving procatuses for 
Mentitying eatp}e 
Populations, axrangjag. ° 


tor data collection froa 


Sdentiflod-samplen ahd * 
collecting the dath ab 
wal) an delivering the’ 
data for processing, 
analyals and + 


: Anterpratation, « ov! 


“ork ain fommulin! 
svatuators on a, = 
aumeineant to Cn 
{laid demands for’, 
Sivalopent of me 


Initietus neoda 
assegamant with regard 
to dissumination 


activities, 


Detepnines disveninatlon 
porfSrmatce requiresents 


} and constrainta, 


Performs nisaion analysis, 
. functional analysis, 
} tabh analysia and 


wethod/aeane analyals 
fot dissemination of 
product, 


yi nal Summative 
1 — 


gan for any external 
sain eviduation of 
need statement, 


Evaluates the adequacy 
of the need tatenant, 


byulops ‘procul 
collects ae 
nla the 
thle should Inch af 
factors as — 
of the number of people 
affected, the social 
significance of the need, ‘ 
the absence of : 
substitutas, the urgency 
of the matter, the 
pousdbility of io 
aultiplicity affects. © GF 
Need atatenente may DO 3? 


darived from such sourcag’ , 
an the Learner, the 
society or the alia ? 
matter. 
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$ 3 External Summative 
Program Management Development Tield Relations : Dissenlnation Formative Evaluation Evaluation 
G 
OMJECTIVES 4 ; os ? 
4 : ; 
‘ Purpose Approvas statements of Ganarates general goals Reviews product Ganerates dissemination Initiates the Arrangan for any external | Evaluates the objectives, 
inatructional system's and refines objectives objectives, Objectives in - operationalization of nmative evaluation of ; 
Behavioral Qutcosa purpose and behavioral of Inetructional ‘system; % collaboration with | product objectives for the objectives, 
* Objectives ; Objectives at wach stage | to be completed by Provides feedback to davalopers and evaluators. | measurement purposes, 
during planning, product | iterative process, developers and |. (Determines relevant Provides feedback ‘to ' 
Behavioral Instrumental | development and ; evaluators concerning : domaing of variables from | formative evaiuatore 
Objectives evaluation as iterated, Coblaboraten and concurs | potential’ target groups objectives.) concerning the degree 
There itatanents are with evaluation to tor vhon the objectives ; ; to which the statenents 
considered in relation to cacti and are ralevant, Chanelllas objectives of objectives serve to 
thelr appeopriatensss to | classify objectives, : {nto categorian an deliait the selection 
Program puspose, values appropriate. Ona poanibla| or development of | 
and feasibility within | Revises statenents of * 8 categorization schene instrumentation 
Program resources, objectives vhen : ¢ wlght be: (technique items, 
F appropriate on the basis . a, : | bcoring keys, empirical a 
Approven approprlavenens | of texting and inputs : Pr 1, Instructional | bape for constructs ly aa Ba 
of expert reviewers ant | frou (eld relations . q objectives {trhines ip. 
review proceduran, axcapt | and formative and behavior) ‘ a 
4 + | for externa) summative | summative evaluation, - ~ ‘ ‘ 
taview, 2, Trstrunental a ‘ ‘ \ 
objectives (trained . \ 
\ : bf behavior) : ; 
4 oe J, Outcome objectives 
. or Indicators 7 
bog (trainee objectives} } 
vf . : 4, Impact objectives Y 
i: s or Indicators a 
levidence that : i 
changea in trainee r aa 
behavior made any - ae 
: ; . differences ins acre 
: vecondary target . , ut pe 
: group) ve : 


5, Implementation > 
objectivae (trainer 
behavior) ar ¢r 


Other factors ta bé 

’ connidered are the 
prerequisite competancics 
or experiencas of the 
learner and social and 


ae paychological 
Column headings should be read as functions oe of the 


(not roles or person}, Head{ngs in Column | 

| denote five major classes of activittes, No 
particular sequence Or temporal relationship 

_ {Is necessarily tmplied, Entries should not 
be. read as prescriptive for any particular 
work unit. Again, no particular sequence or 
tespora| relationship 1s necessart ly taptted, 
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\ Reporta 
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TES PROGRAM 


speciticat 
appropr bal 
purpose, wf 
feaaldliley 
those vhig e) 
prenpecl (0 aa 
which are emergant: 
Approves aelection and 
iterations of contant, 
{neteuctionat dasign and 
materiale a¢ consietent. 


& Responsible for 
H yenaration and revision, 


as a raglt of teating, 
of contant, aaterials, 


instructional processes, 


participant processes, 
workshop climte 
specifications, 
participant 
Prerequisites, workshop 
apect cations and 


tralner qualiticetjons, : 


: al ; a 2 


with design specifications Ovébions editing needa 


and evaluations at sach 
atage of davelopment. 


* Approves appropriateneda 
of expart raviewers and 
expert review procedures 


{n collaboration with 


+ editor, 


Contributes to | # 
identification and 


} ‘ review of potentially 
> te | except tor extarnal competitive ayatens, 
& | namative assessment, ‘4 
Approves reporte of : 
Planning and progress on \ 
creation and {teratipna r ‘ 
of the Instructional. 
g ayaten, 
oy 4 
U 
: ? 
4 1 
Coluan aia: ‘should be retd as functions 
{not roles or person), Headings in Column 1 \ 
denote five major classes of activites. Mo ' : 
+: {particular sequence of temporal relatfonshtp : 
“THs necessarily teplied. Entries should tot es 
be read as prescriptive for any particular ; 2 
work unit. Agaln, mo particular sequence or |} 
teaporal relationship 1s necesuartly taplted, |" 
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Iditiates and arranges 
for markating durvays'to 
aacertaln tha likely 
reachable narket. 


Oke 


é 


Ganerates cha atratogy 
‘tor disamination, This 
fwould include identiying 
the role of the regional 
network, publishers, 
tralning cadres, colleges 
and universities, state 
departwonts of aducation 
and school districts. 


Deterninga promotional 


“| material for different’ 
) audiences and potential 


diatribution. 


Whojecta potential 


targat audiences, 


partied 


spect ficatlonfly, 
or 


it content spaci fications 
aka not ada axplicit, 


| then formative svaiuation 


provides for (sedback 

on the apparent contant 
domain (may require 
expert raview). , 4 


the sane function a 


_| described above for 


content specifications 
{p appropriate for 
materials specifications 


1 and strategies 


upecif ications. 


Formative evaluation / 

obtains and feeds back 

cost {aformation =‘ ” 

Into the 

falloving Gategorias: 

1, Developeent only 
comty 


2, Product costa 


a 

}, Delivery couta 
axclusive of product 
coats 


4, Maintenance costs 


Arranges for extarnal 
taview of product in 
reqard to goals, content, 
atrategles, 
Ghayem{nability and 
coat/banefit potentials 
for developers, 
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re ae 
‘TESTING ‘ 
. Rvaluation Destyns Approves appropriateneas | Provides evaluators with 
and feasibility of formative evaluation 
Tnetrumentation Criterde| evaluation designs and © | needs, 
4 ingtrumantation criteria 
Bhort-Term kttecta for short- and long-term | Provides inputs to” 
; aftecte throughout pamative evalustion, 
Long-Term Effects Cormacive evaluation, 
. | Partiolpaten and observed 
Critical Comparieona britiquss the in field telad during 
aptapelatenest and Wy atages of 
Expert Review adequacy'of {{itustion + | Mvelommenty later 
feaigns ind ” aa, observes, 
eat Reporte trumentation criteria 
i . for intarnal summative Sj telps develop 
'Y avaluation and advises on | Inatrumentation criteria 
faadbility, * lor evaluative ante 
Including trainee” 
Approves Program clalas | outcomes, wecondary 
for une dn critical, cutcones, coata 
compar {sone ") | Anatallation and critical 
‘ conpatitora, 
Provides recomendations ai * 
of posedble comparivone, | Conture with eveluators 
On Corsative evaluation 
Approvas ravievera designe, 
talected (ox subptantive ee 
; yo, appropriatenana except Tnpute and critiques 
for external summative Interns) sumative 
evaluation, i 
Approves appropedatenens 
of review procedures, ( ay 
Approved adequacy and 5 a6 F 
validity of formative 
test reports and 
; ctitiquas approprlatencas 
of intatna) gumative 
Cast reporta, 
Detarainas that 
arranggeents ave completed ar 
for thd necaasary forms, |, 
clearegce procures and 
protection of human 
wubjecta procedures, =, 
h ‘y 
Column headings should be read as functions > 
(not roles or ie Headings in Colum} } 
denote five mafor classes of activites, Mo |" 
particular sequence op teaporal ralatlonship 
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Reviews avaluation 
design, 


Provides feedback 
concerning feasibility 
of deaign. 


Tdentifien subjecta and 


| artangea apprdpetate 


alte conditiohs for 
tanting products during 
al) sagas of 
daveidpnent,, 

Ds 
Provides compatant 
tnetallere and trainera 
for formative and 
internal summative 
evaluation, 


Ydentdfias potential 
aites for external 
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compatant trainare and 
qualifled participants, 
vhan appropriate, for 
external summative 
valuation, 
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teating to various 
appropr lata andiences, 
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Formative Evaluation 


Selects and/or develops 
inetrunentation for 
formative use, would 
include instrumeietion 
for capturing rasponsan 
nade during the process of 
{oatruction and responses 
wads to end of workshop 
criterlon taate or 
manirel, 


Devalops designe and 
inatrumentation to canons 


lamediata wekshop affecta.}. 


Possible areas in which 
affecta my be exaeined 
Ineluday 


I, Tralnee knowledge 


+ 


2, Tradnea attitudes 


a. About att 
b. Aout ather people 
or things 


3, Trainea behavior 


| atc.) 


' 


Develops daniqns and 
inatrunentation to anseaa 
long-term effects vhen 
thie Information Ie 
taaded by developsent 
atafl to asslet product 
development, 


conucts CH dgaignd ; 


studies, : wis 


te ta the 
‘lead 


Provided: 
{ile on: 
ceapatttoes, 
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Internal Summative 
Evaluation 


Reviews and approves 
formative bnatrumentation 
for pumative vee. 


Balocte or develops 
inatrupentation for 
pamative study, 


Thacrupentation wuld 
be developed for, tha 
following: 


1, Workshop outcomes 


2, Long-range trainee 
effects 


), Tapact 


4a Other varleblas 
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{aportant control 
variables ox have 
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Ube treslment to 
affect outcomes 


Initdates and 
collaborates with 
tormative evaiuator to 
design inetrusent 
devalopment and valida 
tion proceduras to be 
used for both formative 
and mamtive work, 


Deslghe and conducts 
sutmative atudien for 
“gusesaing workehop 
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External Summative 
Evaluation 


Evaluates 
(netrumentation, 


haplicates evaluation - 
atudi an conducted to 
aanace Lamedieta 
workshop affects, : 


*heplicataa sthe 

evaluation atudiaa 
conducted to ansaae 
long-range effects, 
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uy 
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Formative Eveluatlon 


thald Relations 


* Conditions for Use Approves proteduras and ( Generates dissemination | Provides a digswmination | Works collaboratively with | Arrangas for any Evaluates the 
naterdale:(pte'Laplomanting , Jesuer, plan wilch {ecludent Alsmumination to develop | external evaluation of GU ffurton/dissestination 
Inatallation Steps use of Inatiuctional =’ proceduras for and diftusion/dissanination | atrategy, 
ayttem ae congruent with Provides feedback 1, Arranging for collects infornation vatrategy. ' 
Alternative Olffusion/ | Program purpose and ; concerning problens snd training of concerning tha Prograa'e ¢ 
ret Oisnemination dtrategies| Valuen, evaluation data, conttreints for . iseanination dif fuslon/di examination . : 
i and logical conceptions developers, evaluators banageré and senior | strategies, 
Product Reporta/Selee | regarding usar conditions and prograa managers, trainers ; 
“Literature and atepe for’ Develops procedures for ‘ : 
inetallation, . Arranges for 2, Preparing region) | and collects infortation 
‘ Installation sites, tatwork, cadres, concerning the marketing ' 
Approves Program ‘ colleges, ard sales of Program's 
_ | strategiva to support Provides tralnare vhen * undversdties, state | products, : 
a difimalon and nated, departwente and ee 
F me Including achool districts to | Helps identity alternative * , \ 
aslen Literature as Frovides Infornation for deliver producty — | ddffunton/diseentnation/ ; , 4 
, <jiperopelate to purpose evaluators and developare marheting strategies, : : 
and values of the Program concerning necesaaty 3, Providing training 
and ap conslatent with Installation procedurae, for inatallation Arranged for any external ‘ 
perceptions and : \ managers review of atrateglar, : 
\ évaluatione gained during ¥. Provides training for o 
development, b Anstellora-and tratners 4, Developing 
5 for formative and » alternative « ; a 
Approvan and recomende na internal sumative dittuslon/ ; , : 
product readiness for evaluation testa, dissemination uy 
” publication, ; ; strategies : ; } r ; 
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‘ 5. Arranging for any ; 
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‘ yaa 6, Collaborating with \ wy 
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Gnd judgments for potential users of the system. This shift in emphasis 


is illustrated in Figure 1. 
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a os A | 
Developmental Phases: Planning Pilot Interim Field Outcome 


The following paragraphs. describe in general terms the ways devélop- : 


ment and evaluation activities are organized for each phase of product ~ 


development. - : ; etic % Si es - 


ang 
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Planning Phase. “In this. phase, several key acedvinies provi the 
b ; 
ry ? 


a *e, 
: ihafocus, for. | BEEOER. ‘The initial conception of the proposed instructional 
‘systew-is described along with its apcendeds eps Rea ven: “A-need-for-the: - ri 


proposed sygtém is documented and evidénce provided on adequate 


bd : 
uational strateiges exist or can be developed 


conceptualizations and ing 


feasibly son, the propos ing. package. tnielet deyeropment eee 


evaluatuion and dis genination plans: are produced, as are ‘timelines, 
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Pilot Phase. In th phase, a prototype of the. instructional system 
’ a on t : ic 


yo 
» 7 ~ 
is developed and tried out on a small group . of ‘hsers from the .target 
- 
obectives of the Bysten and entry conditions for aia i 


\ staffing needs and b dg 


group. 


“ ' are clarified. — Program evaluators provide formitéve pyetustion information. 
‘The item tastes observer 


. “to: assist developers with révisions.. ; 
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and trainer assessments of participant involvement in the activities, 
wn 
measurements of participant “Satisfaction with the content, strategies and 


°° 


utility of the system. ‘The workability. of the activities, the logte or 


as the content and the quality of... ‘the teaching. aids and materials are ares 


assessed at this phase Ey the user SrOupe: Description and Preliminary 


aSsessment of trainee outcomes. are “initiated. 4 


. The collection of information regarding thé marketability and 


costs of A. mae he sees system sepmmences during the pif phase as 
“ ie, — a 
does the documentation‘of thé developers' claims regarding the intents 
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of the system in const tson to existing alternatives. @ 
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Interim phase, During’ this phase, the instruttional system goes 
: A ae 2 e Cc 
through one or more cycles of revision and a neatly "Finished ‘product is 
: ae Fi - : . ae . i 
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completed. By the end of this euiaec? the appropriateness of, objectives 


has been determined, statements of objectives finalized bad instrumentation 


. fy 
to measure ‘these selected or developed. For instructional systems } a 


requiring a. ) workshop SOmneys spebifications ‘are _ determined for desirable 
* 
: Z . 
<= HOERSnge conditions. ‘and: qualificattons, for: ee tierive. trainers.” 
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The major ‘focus. of the evaluation activities for this phase is on > 


cont irmation Se ‘the system’ s ability to peoaues spueneiea short-term 


s 


' out comes and to test the workshop Sona etLOnA: trainer rere ee and 


dissemination feasibility. This may be accomplished ene through 


conductia a. "criterion ene designed’ to reselible closely the field: 
By 


conditions “The paste: decision served by eguluacion is whe ther the 
v 


ugtional system is’ ready. for internal summative evalvation and. 
ta <a * . ao 


‘adéquate “for comprehensive field and outcome testing.. 
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In dite phases wigbe revisions are made on the - 
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Field Test Phase. 
instructional system and a product close to finished form is expected 


® <= ‘ : : = . 
Ze : 


_to exist. Also, in this phase, -an internal. ‘summative evaluation will 
a 3 . 
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change, but also transfer, eeatee and impa t:ipon secondary audiences 


‘, 


focus on para of: ahort-term outcomes gt the instructional; system. 
spgaitieaity, this ‘means ‘finding answers to questions’ regarding knowledge, 


, 
awareness ene BEC Arye tar srowth, “ang? participant performance change 


that can be expected as a ves Moe's ves participation in the system’ s 
: the eR 
training design under. ‘field conditions with typical trainees, trainers 


and workshop settings. Goetabide related.to problems of installation 
4 


and dissemination may also be examined at this point. 
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Outcome Phase. eee this phase, which: may occur similtancodsly 


such as atudents and/or peers: ; At this’ podd 


for external summative evaluation studies: eich as critical. spupeetaons 


_ between the outcomes of the instructional system being evaluaeed and 


Sy 


outcomes produced by other relevant treatment efforts, External summative’: 


wakes ete dvesee ot = . sae poe 


yaltdaetous of the product are also completed in this en . 


